-- Logs begin at Wed 2021-04-14 15:28:45 UTC, end at Wed 2021-04-14 16:28:49 UTC. -- Apr 14 16:01:49.236882 dv-cinder-786266-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 14 16:01:49.245350 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 14 16:01:49.247350 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Apr 14 16:01:49 2021] *** Apr 14 16:01:49.247350 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 14 16:01:49.247350 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 14 16:01:49.247350 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: nodename: dv-cinder-786266-1-iscsi Apr 14 16:01:49.247350 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: machine: x86_64 Apr 14 16:01:49.247350 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: clock source: unix Apr 14 16:01:49.247350 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: pcre jit disabled Apr 14 16:01:49.247350 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: detected number of CPU cores: 4 Apr 14 16:01:49.247350 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: current working directory: / Apr 14 16:01:49.247350 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: detected binary path: /usr/bin/uwsgi-core Apr 14 16:01:49.247350 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: dropping root privileges as early as possible Apr 14 16:01:49.247350 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: your processes number limit is 47843 Apr 14 16:01:49.248366 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: your memory page size is 4096 bytes Apr 14 16:01:49.248366 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: detected max file descriptor number: 2048 Apr 14 16:01:49.248366 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: lock engine: pthread robust mutexes Apr 14 16:01:49.248366 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: thunder lock: enabled Apr 14 16:01:49.248366 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 14 16:01:49.248366 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: dropping root privileges after socket binding Apr 14 16:01:49.248366 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 14 16:01:49.293985 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: Python main interpreter initialized at 0x55724e7a49c0 Apr 14 16:01:49.293985 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: dropping root privileges after plugin initialization Apr 14 16:01:49.293985 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: python threads support enabled Apr 14 16:01:49.293985 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: your server socket listen backlog is limited to 100 connections Apr 14 16:01:49.293985 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: your mercy for graceful operations on workers is 90 seconds Apr 14 16:01:49.294469 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: mapped 402621 bytes (393 KB) for 2 cores Apr 14 16:01:49.294469 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: *** Operational MODE: preforking *** Apr 14 16:01:49.294642 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: dropping root privileges after application loading Apr 14 16:01:49.294642 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: *** uWSGI is running in multiple interpreter mode *** Apr 14 16:01:49.294642 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: spawned uWSGI master process (pid: 84561) Apr 14 16:01:49.295079 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: spawned uWSGI worker 1 (pid: 84562, cores: 1) Apr 14 16:01:49.294739 dv-cinder-786266-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 14 16:01:49.295492 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: spawned uWSGI worker 2 (pid: 84563, cores: 1) Apr 14 16:01:49.295492 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 14 16:01:54.342676 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 14 16:01:54.343204 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 14 16:01:54.344131 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 14 16:01:54.344438 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 14 16:01:54.344551 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 14 16:01:54.344917 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 14 16:01:54.345234 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 14 16:01:54.345700 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.346023 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 14 16:01:54.346118 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.346407 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.346560 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 14 16:01:54.346709 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 14 16:01:54.346809 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.347120 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.347223 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.347472 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.347572 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.347834 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.347932 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.348184 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.348282 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.348638 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.348757 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.348937 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.349259 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.349370 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.349628 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.349735 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786266-1-iscsi {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.349992 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.350089 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.350333 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.350431 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.350647 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.350794 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.351004 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.351107 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.351343 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.351450 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786266-1-iscsi {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.351712 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.351812 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.352050 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.352153 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.352400 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.352661 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.352772 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.353012 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.353134 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.353386 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.353499 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.353737 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.353842 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.354123 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.354349 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.354454 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.354698 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.354797 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.355042 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.355149 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.355389 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.355495 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.355771 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.355879 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.356144 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.356235 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.356458 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.356573 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786266-1-iscsi {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.356820 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.356918 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.357191 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.357292 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.357546 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.357655 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.357887 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.358028 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.358252 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786266-1-iscsi {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.358356 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.358602 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.358711 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.358952 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.359055 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.359302 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.359399 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.359696 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.359794 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.360075 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.360185 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.360425 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.360523 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.360784 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.360892 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.361166 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.361277 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.361507 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.361622 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.361853 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.361958 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.362200 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.362307 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.362555 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.362653 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.362892 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.362998 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.363229 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.363332 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.363508 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.363611 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.363853 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.363958 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.364786 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.364987 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.365171 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.365515 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.365623 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.365807 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.365909 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.366092 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.366200 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.366442 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.366548 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.366801 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.366904 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.367153 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.367252 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.367500 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.367597 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.367778 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.367887 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.368060 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.368159 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.368425 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.368569 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.368790 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.368897 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.369152 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.369264 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.369492 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.369600 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.369834 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.369944 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.370177 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.370275 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.370519 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.370617 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.370859 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.370962 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.371190 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.371288 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.371532 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.371639 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.371893 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.371998 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.372230 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.372327 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.372587 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.372686 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.372930 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.373029 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.373313 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.373417 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.373676 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.373781 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.374011 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.374109 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.374353 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.374451 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.374699 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.374797 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.375046 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.375147 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.375386 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.375483 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.375742 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.375893 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.376079 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.376189 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.376364 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.376467 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.376703 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.376815 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.377061 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.377164 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.377426 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.377524 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.377765 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.377874 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.378104 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.378203 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.378386 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.378485 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.378721 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.378830 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.379060 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.379164 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.379399 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.379539 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.380315 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.380479 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.380700 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.381072 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.381173 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.381411 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.381520 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.381747 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.381846 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.382086 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.382184 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.382423 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.382531 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.382766 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.382865 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.383110 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.383208 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.383447 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.383556 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.383780 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.383883 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.384118 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.384216 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.384451 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.384559 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.384790 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.384888 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.385158 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.385260 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.385507 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.385606 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.385851 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.385993 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.386188 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.386290 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.386520 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.386619 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.386860 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.386960 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.387197 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.387295 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.387537 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.387636 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.387878 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.387981 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.388208 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.388306 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.388552 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.388656 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.388884 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.388981 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.389267 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.389367 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.389601 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.389700 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.389936 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.390033 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.390276 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.390385 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.390604 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.390702 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.390939 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.391037 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.391280 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.391388 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.391613 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.391710 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.391943 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.392044 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.392276 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.392367 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.392613 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.392717 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.392949 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.393066 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.393313 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.393425 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.393644 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.393742 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.393978 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.394076 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.394312 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.394411 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.394671 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.394770 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.395033 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.395131 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.395483 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.395660 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.395871 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.396180 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.396277 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.396525 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.396639 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.396887 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:01:54.396985 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.397272 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.397380 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.397641 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.397747 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.397987 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.398086 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.398340 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.398438 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.398693 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.398791 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.399061 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.399159 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.399412 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.399510 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.399754 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.399852 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.400104 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.400206 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.400454 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.400557 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.400793 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.400892 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.401166 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.401277 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.401520 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.401623 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.401882 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.402002 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.402235 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.402334 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.402580 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.402678 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.402933 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.403032 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.403283 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.403386 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.403635 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.403734 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.403979 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.404078 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.404328 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.404437 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.404691 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.404789 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.405095 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.405199 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.405408 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.405517 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.405765 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.405865 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.406124 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.406223 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.406479 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.406589 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.406831 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.406919 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.407172 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.407276 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.407537 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.407643 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.407888 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.407993 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.408231 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.408339 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.408570 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.408674 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.408917 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.409020 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.409286 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.409388 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.409626 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.409729 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.409983 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.410097 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.410331 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.410437 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.410678 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.410777 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.411070 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.411183 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.411435 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.411674 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.411772 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.412024 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.412122 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.412371 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.412471 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.412714 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.412812 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.413093 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.413206 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.413440 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.413540 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.413786 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.413884 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.414134 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.414232 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.414477 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.414578 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.414824 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.414931 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.415164 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.415268 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.415497 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.415598 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.415844 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.415948 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.416187 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.416346 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.416520 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.416626 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.416862 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.416961 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.417252 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.417371 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.417596 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.417695 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.417942 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.418041 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.418277 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.418383 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.418618 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.418716 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.418968 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.419072 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.419314 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.419420 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.419662 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.419761 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.420006 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.420110 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.420344 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.420449 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.420691 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.420789 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.421028 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.421186 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.421395 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.421500 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.421740 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.421844 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.422089 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.422187 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.422432 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.422531 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.422775 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.422873 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.423119 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.423217 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.423452 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.423551 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.423788 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.423892 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.424121 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.424227 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.424463 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.424567 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.424801 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.424899 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.425164 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.425277 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.425506 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.425610 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.425847 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.425952 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.426189 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.426297 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.427039 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.427185 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.427407 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.427642 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.427890 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.427999 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.428256 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.428361 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.428609 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.428713 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.428957 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.429085 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.429324 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.429428 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.429671 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.429769 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.430029 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.430135 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.430371 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.430476 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.430724 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.430823 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.431072 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.431181 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.431419 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.431518 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.431773 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.431871 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.432113 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.432212 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.432451 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.432555 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.432796 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.432900 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.433183 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.433287 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.433525 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.433625 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.433872 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.433971 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.434207 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.434307 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.434548 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.434646 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.434899 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.435003 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.435244 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.435349 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.435597 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.435703 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.435943 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.436049 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.436295 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.436393 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.436887 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.436991 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.437258 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.437368 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.437601 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.437700 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.437937 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.438035 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.438279 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.438385 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.438618 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.438718 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.438970 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.439074 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.439315 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.439420 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.439659 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.439758 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.440000 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.440138 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.440341 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.440451 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.440680 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.440778 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.441019 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.441149 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.441380 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.441480 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.441718 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.441817 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.442066 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.442200 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.443046 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.443150 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.443480 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.443675 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.443834 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.444044 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.444186 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.444391 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.444546 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.444735 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.444917 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.445130 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.445318 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.445481 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.445676 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.445826 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.446029 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.446169 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.446384 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.446482 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.446752 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.446910 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.447109 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.447222 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.447462 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.447560 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.447816 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.447914 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.448170 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.448277 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.448510 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.448608 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.448854 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.448954 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.449222 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.449336 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.449570 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.449670 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.449915 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.450020 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.450261 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.450366 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.450600 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.450700 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.450939 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.451038 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.451288 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.451388 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.451640 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.451976 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.452074 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.452336 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.452442 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.452682 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.452781 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.453029 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.453186 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.453402 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.453534 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.453743 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.453865 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.454546 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.454546 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.455144 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.455258 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.455440 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.455541 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.455787 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.455886 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.456140 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.456246 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.456493 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.456591 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.456841 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.456940 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.457225 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.457326 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.457585 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.457685 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.457963 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.458084 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.458312 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.458586 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.458845 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.458944 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.459200 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.459299 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.459551 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.459652 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.459895 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.459995 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.460238 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.460389 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.460575 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.460681 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.460919 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.461018 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.461287 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.461399 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.461623 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.461722 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.461966 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.462066 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.462298 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.462404 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.462640 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.462739 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.462986 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.463092 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.463320 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.463429 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.463659 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.463758 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.463992 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.464092 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.464358 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.464468 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.464705 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.464804 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.465058 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.465161 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.465430 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.465538 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.465771 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.465870 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.466133 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.466231 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.466473 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.466574 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.466832 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.466932 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.467181 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.467280 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.467537 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.467635 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.467879 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.467977 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.468215 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.468314 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.468569 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.468668 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.468904 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.469008 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.469272 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.469383 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.469612 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.469711 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.469948 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.470047 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.470287 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.470392 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.470625 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.470724 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.470968 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.471069 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.471310 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.471416 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.471648 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.471746 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.471983 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.472082 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.472321 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.472427 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.472658 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.472763 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.472990 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.473107 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.473400 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.473520 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.473740 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.473985 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.474084 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.474348 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.474455 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.474695 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.474793 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.475038 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.475136 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.475404 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.475510 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.475747 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.475845 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.476091 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.476189 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.476432 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.476538 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.476769 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.476867 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.477125 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.477228 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.477473 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.477614 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.477818 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.477917 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.478165 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.478263 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.478500 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.478607 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.478839 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.478939 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.479174 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.479273 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.479512 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.479612 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.479845 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.479950 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.480190 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.480290 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.480527 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.480627 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.480860 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.480965 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.481225 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.481325 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.481572 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.481682 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.481913 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.482012 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.482275 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.482379 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.482620 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.482721 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.482960 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.483064 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.483299 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.483398 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.483636 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.483736 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.483978 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.484078 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.484336 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.484442 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.484689 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.484788 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.485096 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.485210 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.485416 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.485523 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.485761 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.485861 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.486106 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.486207 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.486447 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.486553 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.486795 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.486896 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.487135 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.487234 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.487487 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.487593 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.487829 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.487931 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.488168 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.488267 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.488519 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.488626 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.488858 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.489470 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.489884 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.489991 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.490241 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.490341 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.490593 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.490693 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.490947 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.491045 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.491303 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.491408 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.491657 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.491755 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.492012 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.492111 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.492366 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.492466 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.492716 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.492816 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.493082 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.493186 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.493440 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.493541 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.493788 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.493887 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.494140 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.494252 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.494486 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.494584 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.494832 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.494936 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.495179 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.495285 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.495518 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.495623 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.495864 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.495963 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.496207 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.496313 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.496573 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.496673 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.496925 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.497044 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.497324 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.497726 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.497818 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.497892 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.498018 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.498116 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.498359 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.498472 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.498686 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.498791 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.499086 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.499185 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.499434 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.499534 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.499838 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.499942 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.500185 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.500287 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.500539 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.500639 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.500892 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.500999 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.501262 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.501389 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.501611 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.501715 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.501951 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.502050 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.502317 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.502415 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.502666 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.502772 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.503013 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.503112 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.503362 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.503472 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.503724 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.503824 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.504063 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.504162 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.504408 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.504517 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.505444 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.505554 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.505803 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.505982 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.506154 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.506334 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.506636 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.506735 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.506991 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.507096 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.507345 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.507451 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.507706 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.507805 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.508070 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.508196 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.508443 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.508542 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.508791 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.508895 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.509172 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.509329 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.509531 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.509686 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.509904 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.510029 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.510275 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.510374 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.510631 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.510730 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.510991 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.511093 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.511340 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.511438 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.511713 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.511813 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.512064 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.512169 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.512417 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.512522 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.512778 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.512876 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.513155 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.513258 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.513516 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.513626 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.513866 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.513965 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.514237 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.514337 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.514607 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.514717 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.514956 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.515061 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.515306 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.515404 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.515660 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.515766 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.516006 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.516106 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.516363 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.516468 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.516734 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.516841 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.517119 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.517229 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.517469 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.517568 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.517813 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.517919 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.518158 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.518288 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.518499 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.518598 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.518839 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.518938 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.519198 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.519296 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.519536 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.519639 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.519892 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.520002 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.520267 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.520429 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.520632 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.520800 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.520971 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.521189 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.521349 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.521536 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.521718 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.521901 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.522068 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.522245 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.522413 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.522612 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.522757 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.522966 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.523106 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.523332 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.523499 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.523699 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.523844 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.524043 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.524208 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.524409 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.524585 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.524759 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.524960 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.525122 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.525354 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.525453 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.525736 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.525835 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.526106 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.526212 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.526469 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.526573 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.526824 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.526923 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.527194 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.527294 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.527532 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.527636 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.527876 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.527976 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.528228 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.528326 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.528572 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.528671 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.528917 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.529016 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.529289 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.529400 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.529638 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.529745 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.529980 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.530079 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.530318 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.530424 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.530659 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.530759 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.531002 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.531147 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.531341 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.531452 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.531676 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.531777 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.532024 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.532125 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.532362 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.532468 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.532696 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.532801 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.533059 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.533163 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.533447 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.533555 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.533785 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.533899 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.534146 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.534246 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.534495 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.534594 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.534839 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.534937 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.535180 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.535287 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.535523 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.535624 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.535914 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.536042 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.536255 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.536593 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.536704 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.536924 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.537023 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.537313 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.537414 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.537672 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.537774 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.538023 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.538122 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.538375 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.538510 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.538723 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.538823 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.539068 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.539167 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.539413 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.539512 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.539765 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.539865 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.540112 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.540211 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.540464 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.540710 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.540809 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.541103 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.541207 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.541466 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.541565 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.541813 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.541913 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.542159 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.542264 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.542520 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.542747 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.542853 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.543115 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.543217 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.543468 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.543599 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.543820 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.543986 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.544169 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.544269 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.544526 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.544627 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.544876 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.544984 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.545263 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.545363 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.545614 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.545725 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.545964 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.546064 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.546312 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.546418 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.546665 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.546772 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.547028 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.547129 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.547400 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.547500 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.547773 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.547883 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.548121 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.548220 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.548471 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.548596 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.548822 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.548932 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.549201 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.549303 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.549559 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.549671 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.549916 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.550018 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.550262 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.550368 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.550616 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.550722 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.550968 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.551069 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.551312 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.551411 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.552170 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.552406 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.552571 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.552670 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.552830 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.553048 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.553212 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.553445 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.553546 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.553811 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.553911 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.554172 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.554278 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.554528 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.554639 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.554888 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.554988 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.555264 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.555485 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.555592 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.555842 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.555942 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.556221 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.556321 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.556594 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.556694 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.556969 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.557212 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.557366 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.557566 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.557728 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.557942 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.558101 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.558311 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.558449 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.558677 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.558829 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.559029 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.559128 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.559386 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.559485 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.559758 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.559865 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.560105 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.560205 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.560449 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.560549 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.560791 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.560896 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.561163 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.561266 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.561753 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.561859 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.562122 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.562373 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.562473 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.562777 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.562876 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.563128 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.563235 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.563475 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.563575 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.563841 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.564085 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.564185 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.564483 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.564584 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.564838 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.564939 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.565213 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.565328 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.565564 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.565663 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.565912 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.566015 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.566259 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.566365 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.566601 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.566702 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.566943 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.567043 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.567850 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.567964 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.568206 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.568414 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.568557 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.568766 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.568910 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.569149 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.569254 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.569498 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.569608 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.569873 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.569980 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.570222 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.570323 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.570563 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.570670 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.570896 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.571002 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.571243 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.571342 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.571579 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.571687 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.571918 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.572025 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.572252 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.572357 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.572588 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.572687 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.572922 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.573030 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.573288 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.573397 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.573623 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.573722 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.573963 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.574071 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.574304 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.574403 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.574642 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.574741 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.574980 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.575090 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.575315 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.575415 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.575655 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.575760 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.575996 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.576103 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.576333 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.576432 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.576666 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.576765 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.577018 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.577158 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.577376 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.577483 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.577717 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.577822 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.578061 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.578163 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.578399 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.578499 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.578764 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.578863 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.579112 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.579375 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.579474 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.579756 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.579856 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.580122 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.580223 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.580511 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.580733 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.580898 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.581141 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.581294 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.581506 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.581646 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.581893 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.581993 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.582281 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.582416 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.582629 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.582759 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.583009 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.583109 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.583355 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.583462 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.583704 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.583804 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.584047 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.584152 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.584393 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.584493 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.584731 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.584831 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.585095 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.585208 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.585448 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.585549 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.585788 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.585888 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.586134 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.586233 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.586484 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.586591 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.586829 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.586927 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.587174 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.587274 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.587527 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.587627 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.587882 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.587981 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.588231 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.588337 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.588575 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.588676 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.588923 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.589069 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.589298 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.589409 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.589648 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.589748 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.589995 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.590096 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.590337 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.590453 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.590683 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.590783 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.591058 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.591158 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.591409 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.591508 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.591749 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.591850 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.592138 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.592238 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.592517 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.592617 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.592874 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.592974 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.593261 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.593373 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.593609 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.593709 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.593965 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.594070 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.594311 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.594411 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.594659 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.594759 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.595011 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.595111 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.595363 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.595469 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.595703 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.595809 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.596043 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.596148 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.596391 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.596501 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.596780 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.596881 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.597174 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.597281 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.597523 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.597636 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.597869 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.597969 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.598222 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.598321 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.598621 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.598738 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.598986 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.599086 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.599345 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.599445 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.599695 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.599802 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.600039 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.600138 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.600392 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.600497 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.600738 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.600838 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.601111 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.601225 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.601463 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.601562 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.601812 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.601912 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.602154 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.602260 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.602504 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.602633 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.602846 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.602961 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.603198 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.603298 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.603544 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.603640 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.603889 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.603984 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.604256 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.604353 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.604600 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.604702 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.604962 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.605095 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.605330 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.605425 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.605686 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.605791 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.606023 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.606117 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.606387 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.606482 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.606737 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.606842 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.607080 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.607179 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.607428 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.607522 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.607780 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.607882 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.608121 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.608214 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.608463 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.608558 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.608801 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.608914 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.609172 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.609303 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.609520 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.609622 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.609867 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.609967 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.610220 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.610320 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.610579 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.610679 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.610924 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.611030 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.611270 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.611369 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.611620 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.611727 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.611970 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.612069 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.612314 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.612413 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.612657 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.612767 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.613011 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.613164 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.613377 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.613477 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.613728 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.613838 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.614605 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.614712 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.614950 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.615191 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.615291 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.615569 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.615670 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.615946 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.616053 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.616309 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.616418 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.616676 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.616776 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.617058 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.617161 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.617448 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.617556 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.617730 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 14 16:01:54.617830 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.618150 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.618522 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:01:54.618836 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 14 16:01:54.653672 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_db.sqlalchemy.engines [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84562) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:01:54.654046 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_db.sqlalchemy.engines [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84563) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:01:54.995540 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.context [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),967aa7b0-fa4e-4888-a21e-20a4679b0859(cell1) {{(pid=84563) load_cells /opt/stack/nova/nova/context.py:466}} Apr 14 16:01:54.998128 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.context [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),967aa7b0-fa4e-4888-a21e-20a4679b0859(cell1) {{(pid=84562) load_cells /opt/stack/nova/nova/context.py:466}} Apr 14 16:01:55.001022 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:01:55.002967 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:01:55.003640 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:01:55.003845 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:01:55.005937 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:01:55.006057 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:01:55.006818 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:01:55.008937 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:01:55.030902 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_db.sqlalchemy.engines [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84563) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:01:55.037270 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_db.sqlalchemy.engines [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84562) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:01:55.038252 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_db.sqlalchemy.engines [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84562) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:01:55.039242 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_db.sqlalchemy.engines [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84563) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:01:55.064201 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_db.sqlalchemy.engines [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84563) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:01:55.068609 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_db.sqlalchemy.engines [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84562) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:01:55.164863 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 14 16:01:55.164863 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: from cryptography.utils import int_from_bytes Apr 14 16:01:55.165260 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 14 16:01:55.165260 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: from cryptography.utils import int_from_bytes Apr 14 16:01:55.165430 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 14 16:01:55.165430 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: from cryptography.utils import int_from_bytes Apr 14 16:01:55.165658 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 14 16:01:55.165658 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: from cryptography.utils import int_from_bytes Apr 14 16:01:55.242312 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO keyring.backend [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Loading Gnome Apr 14 16:01:55.244479 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO keyring.backend [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] Loading Gnome Apr 14 16:01:55.263326 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO keyring.backend [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Loading Google Apr 14 16:01:55.265698 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO keyring.backend [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] Loading Google Apr 14 16:01:55.266769 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO keyring.backend [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Loading Windows (alt) Apr 14 16:01:55.268931 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO keyring.backend [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] Loading Windows (alt) Apr 14 16:01:55.272352 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO keyring.backend [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Loading file Apr 14 16:01:55.273478 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO keyring.backend [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Loading keyczar Apr 14 16:01:55.273925 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO keyring.backend [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Loading multi Apr 14 16:01:55.274710 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO keyring.backend [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] Loading file Apr 14 16:01:55.274852 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO keyring.backend [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Loading pyfs Apr 14 16:01:55.275821 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO keyring.backend [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] Loading keyczar Apr 14 16:01:55.276271 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO keyring.backend [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] Loading multi Apr 14 16:01:55.277183 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO keyring.backend [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] Loading pyfs Apr 14 16:01:55.552677 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: WARNING keystonemiddleware.auth_token [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 16:01:55.559726 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: WARNING keystonemiddleware.auth_token [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 16:01:55.572105 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: WARNING keystonemiddleware.auth_token [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 16:01:55.579323 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: WARNING keystonemiddleware.auth_token [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 16:01:55.893628 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: WARNING keystonemiddleware.auth_token [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 16:01:55.899956 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: WARNING keystonemiddleware.auth_token [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 16:01:55.906269 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55724e7a49c0 pid: 84562 (default app) Apr 14 16:01:55.908468 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:01:55.909670 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001791 Apr 14 16:01:55.910106 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 779 bytes} [Wed Apr 14 16:01:55 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:01:55.919831 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: WARNING keystonemiddleware.auth_token [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 16:01:55.925520 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: WARNING keystonemiddleware.auth_token [None req-aadf872d-8c35-48a4-9a8f-b957409c5714 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 16:01:55.932996 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55724e7a49c0 pid: 84563 (default app) Apr 14 16:03:22.821833 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:03:22.823588 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002249 Apr 14 16:03:22.829770 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 920 bytes} [Wed Apr 14 16:03:22 2021] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:03:23.355999 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-58f35133-5486-4886-ae3e-8b21676c18f3 admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:03:23.383508 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-58f35133-5486-4886-ae3e-8b21676c18f3 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.551550 Apr 14 16:03:23.397067 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1281 bytes} [Wed Apr 14 16:03:22 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:03:25.949575 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:03:25.950629 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-46ef0329-7568-48f8-b12b-bc1b9c1dd404 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Apr 14 16:03:25.951041 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 920 bytes} [Wed Apr 14 16:03:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:03:26.014860 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-070f629e-e86d-4b0c-863f-e5d7ee53934b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "name": "cirros256", "ram": 256}} {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:26.038894 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:03:26.038894 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: warnings.warn(msg) Apr 14 16:03:26.067105 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-070f629e-e86d-4b0c-863f-e5d7ee53934b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108605 Apr 14 16:03:26.067844 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1272 bytes} [Wed Apr 14 16:03:25 2021] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:03:26.386289 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-d13e7073-0c09-46ef-aab5-4d52076f59e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:26.390237 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:03:26.390237 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: warnings.warn(msg) Apr 14 16:03:26.436367 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-d13e7073-0c09-46ef-aab5-4d52076f59e3 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.359013 Apr 14 16:03:26.437182 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1325 bytes} [Wed Apr 14 16:03:26 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:03:28.991155 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-070f629e-e86d-4b0c-863f-e5d7ee53934b admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:03:28.992236 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-070f629e-e86d-4b0c-863f-e5d7ee53934b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Apr 14 16:03:28.992801 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 920 bytes} [Wed Apr 14 16:03:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:03:29.130346 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-fcc02ddf-6e21-46e3-90ec-80772a4fb947 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "vcpus": 1}} {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:29.155325 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:03:29.155325 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: warnings.warn(msg) Apr 14 16:03:29.180693 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-fcc02ddf-6e21-46e3-90ec-80772a4fb947 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.181424 Apr 14 16:03:29.181819 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1272 bytes} [Wed Apr 14 16:03:28 2021] POST /compute/v2.1/flavors => generated 404 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:03:29.195158 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-80380d7b-c311-4faf-b45d-fc71e08bbdbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:29.196767 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:03:29.196767 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: warnings.warn(msg) Apr 14 16:03:29.236168 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-80380d7b-c311-4faf-b45d-fc71e08bbdbc admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044825 Apr 14 16:03:29.236970 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1325 bytes} [Wed Apr 14 16:03:29 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:03:31.768497 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-fcc02ddf-6e21-46e3-90ec-80772a4fb947 admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:03:31.769626 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-fcc02ddf-6e21-46e3-90ec-80772a4fb947 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Apr 14 16:03:31.770041 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 920 bytes} [Wed Apr 14 16:03:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:03:31.838212 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-0b892d3f-5afa-4fb9-8541-a950452592c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "d2"}} {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:31.864118 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-0b892d3f-5afa-4fb9-8541-a950452592c1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087520 Apr 14 16:03:31.866310 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1272 bytes} [Wed Apr 14 16:03:31 2021] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:03:31.878286 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-855ae80d-e92f-4a1b-813e-6ec0097e798a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:31.920168 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-855ae80d-e92f-4a1b-813e-6ec0097e798a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045554 Apr 14 16:03:31.921772 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1325 bytes} [Wed Apr 14 16:03:31 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:03:34.528065 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-0b892d3f-5afa-4fb9-8541-a950452592c1 admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:03:34.529550 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-0b892d3f-5afa-4fb9-8541-a950452592c1 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001786 Apr 14 16:03:34.530028 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 920 bytes} [Wed Apr 14 16:03:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:03:34.595095 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-e12f43ca-fd28-40ec-a87c-e02c698dbd2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "disk": 10}} {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:34.619106 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-e12f43ca-fd28-40ec-a87c-e02c698dbd2f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082757 Apr 14 16:03:34.619814 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1272 bytes} [Wed Apr 14 16:03:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:03:34.632952 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-8f7e77ef-ff4f-49e5-bc7c-9501aaa389f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:34.669275 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-8f7e77ef-ff4f-49e5-bc7c-9501aaa389f7 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040163 Apr 14 16:03:34.674842 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1325 bytes} [Wed Apr 14 16:03:34 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:03:37.228413 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-e12f43ca-fd28-40ec-a87c-e02c698dbd2f admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:03:37.229564 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-e12f43ca-fd28-40ec-a87c-e02c698dbd2f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Apr 14 16:03:37.229991 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 920 bytes} [Wed Apr 14 16:03:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:03:37.297917 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-b2af5ac3-2302-4db8-b729-58ee02f1bdef admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G", "ram": 4096, "disk": 20}} {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:37.323893 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-b2af5ac3-2302-4db8-b729-58ee02f1bdef admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.086615 Apr 14 16:03:37.324626 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1272 bytes} [Wed Apr 14 16:03:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:03:37.337003 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-fc731963-e78e-49d4-9a5b-c9269fe5c608 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:37.374480 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-fc731963-e78e-49d4-9a5b-c9269fe5c608 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041146 Apr 14 16:03:37.375248 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1325 bytes} [Wed Apr 14 16:03:37 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:03:40.024204 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-b2af5ac3-2302-4db8-b729-58ee02f1bdef admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:03:40.025397 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-b2af5ac3-2302-4db8-b729-58ee02f1bdef admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Apr 14 16:03:40.025787 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 920 bytes} [Wed Apr 14 16:03:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:03:40.097777 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-54b295af-ffe6-4642-a57c-becd4b691de1 admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:03:40.135479 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-54b295af-ffe6-4642-a57c-becd4b691de1 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.102016 Apr 14 16:03:40.136416 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1281 bytes} [Wed Apr 14 16:03:40 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:03:42.742575 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-b2af5ac3-2302-4db8-b729-58ee02f1bdef admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:03:42.743654 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-b2af5ac3-2302-4db8-b729-58ee02f1bdef admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Apr 14 16:03:42.744099 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 920 bytes} [Wed Apr 14 16:03:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:03:42.811207 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-28cde8d9-f56b-4b9b-9af9-2135c64a69cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "id": "1", "disk": 1}} {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:42.843220 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-28cde8d9-f56b-4b9b-9af9-2135c64a69cd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.092021 Apr 14 16:03:42.853160 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1272 bytes} [Wed Apr 14 16:03:42 2021] POST /compute/v2.1/flavors => generated 402 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:03:42.861193 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-069ddaac-d7db-4414-8634-3166df34565f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:42.904033 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-069ddaac-d7db-4414-8634-3166df34565f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047323 Apr 14 16:03:42.904599 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1322 bytes} [Wed Apr 14 16:03:42 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:03:45.519277 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-28cde8d9-f56b-4b9b-9af9-2135c64a69cd admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:03:45.520467 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-28cde8d9-f56b-4b9b-9af9-2135c64a69cd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001671 Apr 14 16:03:45.520993 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 920 bytes} [Wed Apr 14 16:03:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:03:45.583795 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-a75e77b7-30a1-489a-8b18-c0f6381ebec6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2"}} {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:45.608669 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-a75e77b7-30a1-489a-8b18-c0f6381ebec6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081150 Apr 14 16:03:45.609270 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1272 bytes} [Wed Apr 14 16:03:45 2021] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:03:45.622521 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-b10a9f0a-7050-4005-94f9-9d89ac0a2593 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:45.661298 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-b10a9f0a-7050-4005-94f9-9d89ac0a2593 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043031 Apr 14 16:03:45.661919 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1322 bytes} [Wed Apr 14 16:03:45 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:03:48.237980 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-a75e77b7-30a1-489a-8b18-c0f6381ebec6 admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:03:48.239059 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-a75e77b7-30a1-489a-8b18-c0f6381ebec6 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Apr 14 16:03:48.239503 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 920 bytes} [Wed Apr 14 16:03:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:03:48.304630 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-3a2fa98c-e474-454a-b51d-87cc04c0ec88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3", "ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0}} {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:48.330525 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-3a2fa98c-e474-454a-b51d-87cc04c0ec88 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.084602 Apr 14 16:03:48.331457 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1272 bytes} [Wed Apr 14 16:03:48 2021] POST /compute/v2.1/flavors => generated 406 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:03:48.347021 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-b1744325-cace-4219-ac9b-f6309b1059a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:48.386371 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-b1744325-cace-4219-ac9b-f6309b1059a6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043412 Apr 14 16:03:48.386981 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1322 bytes} [Wed Apr 14 16:03:48 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:03:50.951396 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-3a2fa98c-e474-454a-b51d-87cc04c0ec88 admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:03:50.953300 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-3a2fa98c-e474-454a-b51d-87cc04c0ec88 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002618 Apr 14 16:03:50.953957 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 920 bytes} [Wed Apr 14 16:03:50 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:03:51.023504 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-4b350d81-a388-487f-b5a2-2f7290515679 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:51.053968 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-4b350d81-a388-487f-b5a2-2f7290515679 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.093448 Apr 14 16:03:51.054861 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1272 bytes} [Wed Apr 14 16:03:50 2021] POST /compute/v2.1/flavors => generated 405 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:03:51.068828 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-4ecdf16c-d5e8-4231-8104-bc9a60dac9c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:51.109672 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-4ecdf16c-d5e8-4231-8104-bc9a60dac9c6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044821 Apr 14 16:03:51.110852 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1322 bytes} [Wed Apr 14 16:03:51 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:03:53.687885 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-4b350d81-a388-487f-b5a2-2f7290515679 admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:03:53.688942 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-4b350d81-a388-487f-b5a2-2f7290515679 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Apr 14 16:03:53.689623 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 920 bytes} [Wed Apr 14 16:03:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:03:53.756630 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-d8ed3845-ca15-4cd6-8a63-9430c30cd302 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 8, "ram": 16384}} {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:53.783950 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-d8ed3845-ca15-4cd6-8a63-9430c30cd302 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.087861 Apr 14 16:03:53.784551 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1272 bytes} [Wed Apr 14 16:03:53 2021] POST /compute/v2.1/flavors => generated 408 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:03:53.797970 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-11dfa259-7b48-4d9d-a029-6fe3cc746306 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:53.839877 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-11dfa259-7b48-4d9d-a029-6fe3cc746306 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045645 Apr 14 16:03:53.841489 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1322 bytes} [Wed Apr 14 16:03:53 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:04:34.617434 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-d8ed3845-ca15-4cd6-8a63-9430c30cd302 admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:34.618486 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-d8ed3845-ca15-4cd6-8a63-9430c30cd302 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Apr 14 16:04:34.618913 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 920 bytes} [Wed Apr 14 16:04:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:04:34.678171 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-16a5b230-6c08-48a0-bd92-ad3ddb37f2e3 admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:34.705044 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-16a5b230-6c08-48a0-bd92-ad3ddb37f2e3 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.079304 Apr 14 16:04:34.705625 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1281 bytes} [Wed Apr 14 16:04:34 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:04:36.395703 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-d8ed3845-ca15-4cd6-8a63-9430c30cd302 admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:36.396757 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-d8ed3845-ca15-4cd6-8a63-9430c30cd302 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Apr 14 16:04:36.397218 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1065 bytes} [Wed Apr 14 16:04:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:36.578238 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-b2eca2ce-5483-4e00-88f1-5fe05169eeb6 admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:36.592206 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.wsgi [None req-b2eca2ce-5483-4e00-88f1-5fe05169eeb6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 14 16:04:36.592867 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-b2eca2ce-5483-4e00-88f1-5fe05169eeb6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=84563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:04:36.593759 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-b2eca2ce-5483-4e00-88f1-5fe05169eeb6 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.069237 Apr 14 16:04:36.594300 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1181 bytes} [Wed Apr 14 16:04:36 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 14 16:04:36.605092 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-7d0973b3-ad23-4316-b0b2-77082b6bdced admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:36.627453 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-7d0973b3-ad23-4316-b0b2-77082b6bdced admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.027036 Apr 14 16:04:36.628033 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1201 bytes} [Wed Apr 14 16:04:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:04:36.638493 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-9ff82a4e-917e-4a1b-9c57-5a4183299788 admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:36.660521 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-9ff82a4e-917e-4a1b-9c57-5a4183299788 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025884 Apr 14 16:04:36.661019 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1201 bytes} [Wed Apr 14 16:04:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:04:36.671676 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-2690fb98-22c7-4060-8fbf-602de0da74f6 admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:36.686072 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.wsgi [None req-2690fb98-22c7-4060-8fbf-602de0da74f6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 14 16:04:36.686691 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-2690fb98-22c7-4060-8fbf-602de0da74f6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=84562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:04:36.687529 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-2690fb98-22c7-4060-8fbf-602de0da74f6 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.019647 Apr 14 16:04:36.688058 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1181 bytes} [Wed Apr 14 16:04:36 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 14 16:04:38.253503 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-9ff82a4e-917e-4a1b-9c57-5a4183299788 admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:38.254620 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-9ff82a4e-917e-4a1b-9c57-5a4183299788 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Apr 14 16:04:38.255059 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1065 bytes} [Wed Apr 14 16:04:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:38.436840 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-e9dfd686-028b-41cf-a153-5f7de5dca197 admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:38.450115 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.wsgi [None req-e9dfd686-028b-41cf-a153-5f7de5dca197 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 14 16:04:38.450727 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-e9dfd686-028b-41cf-a153-5f7de5dca197 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=84562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:04:38.451561 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-e9dfd686-028b-41cf-a153-5f7de5dca197 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.068903 Apr 14 16:04:38.452102 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1181 bytes} [Wed Apr 14 16:04:38 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 14 16:04:38.461913 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-25ea4a5f-d0f6-40cc-b7be-114afee36719 admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:38.484786 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-25ea4a5f-d0f6-40cc-b7be-114afee36719 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026644 Apr 14 16:04:38.485383 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1201 bytes} [Wed Apr 14 16:04:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:04:38.495894 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-605dd9d4-19fa-44d6-8c8a-b26a928ae429 admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:38.518076 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-605dd9d4-19fa-44d6-8c8a-b26a928ae429 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026431 Apr 14 16:04:38.518638 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1201 bytes} [Wed Apr 14 16:04:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:04:38.529118 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-f594fa8b-05c4-44a7-bc29-a10e25397b46 admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:38.543357 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.wsgi [None req-f594fa8b-05c4-44a7-bc29-a10e25397b46 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 14 16:04:38.544009 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-f594fa8b-05c4-44a7-bc29-a10e25397b46 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=84563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:04:38.544842 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-f594fa8b-05c4-44a7-bc29-a10e25397b46 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.020180 Apr 14 16:04:38.545433 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1181 bytes} [Wed Apr 14 16:04:38 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 14 16:04:40.156687 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-605dd9d4-19fa-44d6-8c8a-b26a928ae429 admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:40.157805 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-605dd9d4-19fa-44d6-8c8a-b26a928ae429 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Apr 14 16:04:40.158242 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1065 bytes} [Wed Apr 14 16:04:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:40.340133 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-8ef1eb92-6636-4125-a34d-792309bef45a admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:40.353098 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.wsgi [None req-8ef1eb92-6636-4125-a34d-792309bef45a admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 14 16:04:40.354439 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-8ef1eb92-6636-4125-a34d-792309bef45a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=84563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:04:40.355280 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-8ef1eb92-6636-4125-a34d-792309bef45a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.068943 Apr 14 16:04:40.355827 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1184 bytes} [Wed Apr 14 16:04:40 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 14 16:04:40.366088 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-d0cc59a8-a46f-4555-b23f-b04e529ca0c5 admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:40.388304 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-d0cc59a8-a46f-4555-b23f-b04e529ca0c5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026141 Apr 14 16:04:40.388876 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1201 bytes} [Wed Apr 14 16:04:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:04:40.399003 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-5ea76860-b950-4829-a799-bb7b5832281b admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:40.421621 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-5ea76860-b950-4829-a799-bb7b5832281b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026480 Apr 14 16:04:40.422197 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1201 bytes} [Wed Apr 14 16:04:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:04:40.433098 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-17f6373f-882a-48c7-a32f-3784e47f4fa6 admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:40.445883 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.wsgi [None req-17f6373f-882a-48c7-a32f-3784e47f4fa6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 14 16:04:40.446491 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-17f6373f-882a-48c7-a32f-3784e47f4fa6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=84562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:04:40.447316 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-17f6373f-882a-48c7-a32f-3784e47f4fa6 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.018571 Apr 14 16:04:40.447842 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1184 bytes} [Wed Apr 14 16:04:40 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 14 16:04:42.077653 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-5ea76860-b950-4829-a799-bb7b5832281b admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:42.078750 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-5ea76860-b950-4829-a799-bb7b5832281b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Apr 14 16:04:42.079174 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1065 bytes} [Wed Apr 14 16:04:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:42.266803 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-4270dd53-112c-49c6-8d4a-fdb14d9f08e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:04:42.291464 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-4270dd53-112c-49c6-8d4a-fdb14d9f08e4 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.078670 Apr 14 16:04:42.291988 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1226 bytes} [Wed Apr 14 16:04:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:04:43.858241 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-5ea76860-b950-4829-a799-bb7b5832281b admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:43.859327 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-5ea76860-b950-4829-a799-bb7b5832281b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Apr 14 16:04:43.859807 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1065 bytes} [Wed Apr 14 16:04:43 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:04:44.043775 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-d280a33d-0e9e-4ddf-8e7f-b1fbd4d4c556 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:04:44.067670 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-d280a33d-0e9e-4ddf-8e7f-b1fbd4d4c556 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.078549 Apr 14 16:04:44.068250 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1226 bytes} [Wed Apr 14 16:04:43 2021] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:04:45.641283 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-5ea76860-b950-4829-a799-bb7b5832281b admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:45.642346 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-5ea76860-b950-4829-a799-bb7b5832281b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Apr 14 16:04:45.642781 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1065 bytes} [Wed Apr 14 16:04:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:45.827272 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-82f21112-81cf-4bb9-8372-41b197d14b82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:04:45.854753 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-82f21112-81cf-4bb9-8372-41b197d14b82 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.081746 Apr 14 16:04:45.855280 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1226 bytes} [Wed Apr 14 16:04:45 2021] POST /compute/v2.1/flavors => generated 407 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:04:47.423876 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-5ea76860-b950-4829-a799-bb7b5832281b admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:47.424994 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-5ea76860-b950-4829-a799-bb7b5832281b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Apr 14 16:04:47.425482 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1065 bytes} [Wed Apr 14 16:04:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:47.610486 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-8c28486b-b252-4ec6-8f5b-8112c3ab35b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:04:47.636693 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-8c28486b-b252-4ec6-8f5b-8112c3ab35b0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.080323 Apr 14 16:04:47.637271 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1226 bytes} [Wed Apr 14 16:04:47 2021] POST /compute/v2.1/flavors => generated 409 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:04:49.226804 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-5ea76860-b950-4829-a799-bb7b5832281b admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:49.227872 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-5ea76860-b950-4829-a799-bb7b5832281b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Apr 14 16:04:49.228302 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1065 bytes} [Wed Apr 14 16:04:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:49.416570 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-05919308-aa8a-479b-8141-9ce47eff8a36 admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:04:49.445926 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-05919308-aa8a-479b-8141-9ce47eff8a36 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.087684 Apr 14 16:04:49.446485 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Apr 14 16:04:49 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:05:40.900282 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-5ea76860-b950-4829-a799-bb7b5832281b admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:05:40.901375 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-5ea76860-b950-4829-a799-bb7b5832281b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Apr 14 16:05:40.901815 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 31/63] 10.222.0.60 () {56 vars in 1065 bytes} [Wed Apr 14 16:05:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:05:41.086468 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-7a8ff89f-ee19-4acf-a5b8-8a57814fb691 admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:05:41.114616 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-7a8ff89f-ee19-4acf-a5b8-8a57814fb691 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.081918 Apr 14 16:05:41.116030 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Apr 14 16:05:41 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:07:08.173061 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-ae934627-779d-4f21-8dcc-85e2560a8e3a tempest-verify_tempest_config-133595090 tempest-verify_tempest_config-133595090-project] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:07:08.175176 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-ae934627-779d-4f21-8dcc-85e2560a8e3a tempest-verify_tempest_config-133595090 tempest-verify_tempest_config-133595090-project] 10.222.0.60 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.124869 Apr 14 16:07:08.175748 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 32/65] 10.222.0.60 () {58 vars in 1124 bytes} [Wed Apr 14 16:07:08 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:08:40.380274 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-7a8ff89f-ee19-4acf-a5b8-8a57814fb691 admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:08:40.381328 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-7a8ff89f-ee19-4acf-a5b8-8a57814fb691 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Apr 14 16:08:40.381763 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 34/66] 10.222.0.60 () {56 vars in 1065 bytes} [Wed Apr 14 16:08:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:08:40.650965 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-5f9f5aaf-dccd-491e-99ab-f2c2a9d6fed0 admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:08:40.652256 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:08:40.652256 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: warnings.warn(msg) Apr 14 16:08:40.654441 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-5f9f5aaf-dccd-491e-99ab-f2c2a9d6fed0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:08:40.655275 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-5f9f5aaf-dccd-491e-99ab-f2c2a9d6fed0 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=84563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:08:40.656118 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-5f9f5aaf-dccd-491e-99ab-f2c2a9d6fed0 admin admin] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:08:40.656592 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-5f9f5aaf-dccd-491e-99ab-f2c2a9d6fed0 admin admin] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=84563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:08:40.696873 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-5f9f5aaf-dccd-491e-99ab-f2c2a9d6fed0 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.179562 Apr 14 16:08:40.697491 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1184 bytes} [Wed Apr 14 16:08:40 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:08:42.286631 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-7a8ff89f-ee19-4acf-a5b8-8a57814fb691 admin admin] Calling method '>' {{(pid=84562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:08:42.287730 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-7a8ff89f-ee19-4acf-a5b8-8a57814fb691 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Apr 14 16:08:42.288166 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84562|app: 0|req: 35/68] 10.222.0.60 () {56 vars in 1065 bytes} [Wed Apr 14 16:08:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:08:42.474317 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG nova.api.openstack.wsgi [None req-c668effd-6f3a-4c0d-9af8-35b3331b6b2c admin admin] Calling method '>' {{(pid=84563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:08:42.475621 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:08:42.475621 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: warnings.warn(msg) Apr 14 16:08:42.477743 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-c668effd-6f3a-4c0d-9af8-35b3331b6b2c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:08:42.478242 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-c668effd-6f3a-4c0d-9af8-35b3331b6b2c admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=84563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:08:42.479083 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-c668effd-6f3a-4c0d-9af8-35b3331b6b2c admin admin] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:08:42.479556 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: DEBUG oslo_concurrency.lockutils [None req-c668effd-6f3a-4c0d-9af8-35b3331b6b2c admin admin] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=84563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:08:42.507368 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: INFO nova.api.openstack.requestlog [None req-c668effd-6f3a-4c0d-9af8-35b3331b6b2c admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.088519 Apr 14 16:08:42.508771 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: [pid: 84563|app: 0|req: 34/69] 10.222.0.60 () {60 vars in 1184 bytes} [Wed Apr 14 16:08:42 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:09:43.334748 dv-cinder-786266-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 14 16:09:43.335435 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: Wed Apr 14 16:09:43 2021 - graceful shutdown triggered... Apr 14 16:09:43.335879 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: Gracefully killing worker 1 (pid: 84562)... Apr 14 16:09:43.335974 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: Gracefully killing worker 2 (pid: 84563)... Apr 14 16:09:44.336282 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: worker 1 buried after 1 seconds Apr 14 16:09:44.336282 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: worker 2 buried after 1 seconds Apr 14 16:09:44.336282 dv-cinder-786266-1-iscsi devstack@n-api.service[84561]: goodbye to uWSGI. Apr 14 16:09:44.338075 dv-cinder-786266-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 14 16:09:44.339758 dv-cinder-786266-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 14 16:09:44.347757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 14 16:09:44.349769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Apr 14 16:09:44 2021] *** Apr 14 16:09:44.349769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 14 16:09:44.349769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 14 16:09:44.349769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: nodename: dv-cinder-786266-1-iscsi Apr 14 16:09:44.349769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: machine: x86_64 Apr 14 16:09:44.349769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: clock source: unix Apr 14 16:09:44.349769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: pcre jit disabled Apr 14 16:09:44.349769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: detected number of CPU cores: 4 Apr 14 16:09:44.349769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: current working directory: / Apr 14 16:09:44.349769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: detected binary path: /usr/bin/uwsgi-core Apr 14 16:09:44.349769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: dropping root privileges as early as possible Apr 14 16:09:44.349769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: your processes number limit is 47843 Apr 14 16:09:44.349769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: your memory page size is 4096 bytes Apr 14 16:09:44.349769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: detected max file descriptor number: 2048 Apr 14 16:09:44.350972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: lock engine: pthread robust mutexes Apr 14 16:09:44.350972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: thunder lock: enabled Apr 14 16:09:44.350972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 14 16:09:44.350972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: dropping root privileges after socket binding Apr 14 16:09:44.350972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 14 16:09:44.397374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: Python main interpreter initialized at 0x55793194d9c0 Apr 14 16:09:44.397374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: dropping root privileges after plugin initialization Apr 14 16:09:44.397374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: python threads support enabled Apr 14 16:09:44.397374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: your server socket listen backlog is limited to 100 connections Apr 14 16:09:44.397374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: your mercy for graceful operations on workers is 90 seconds Apr 14 16:09:44.397916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: mapped 402621 bytes (393 KB) for 2 cores Apr 14 16:09:44.397916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: *** Operational MODE: preforking *** Apr 14 16:09:44.398053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: dropping root privileges after application loading Apr 14 16:09:44.398053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: *** uWSGI is running in multiple interpreter mode *** Apr 14 16:09:44.398053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: spawned uWSGI master process (pid: 99333) Apr 14 16:09:44.398238 dv-cinder-786266-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 14 16:09:44.398515 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: spawned uWSGI worker 1 (pid: 99334, cores: 1) Apr 14 16:09:44.409082 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: spawned uWSGI worker 2 (pid: 99335, cores: 1) Apr 14 16:09:44.409082 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 14 16:09:49.775288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 14 16:09:49.775877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 14 16:09:49.777267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 14 16:09:49.777726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 14 16:09:49.778032 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 14 16:09:49.778516 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.778901 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.779283 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.779657 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.780055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.780417 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.780794 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.781194 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.781588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.781900 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.782270 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.782806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786266-1-iscsi {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.783754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.784240 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.784823 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.785245 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.785864 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.786249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.786612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.787262 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.787631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.787993 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.788358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.788767 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.789162 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.789528 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.789917 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.790279 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.790671 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.791039 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.791421 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786266-1-iscsi {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.791795 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.792163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.792531 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.793073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.793444 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.793807 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.794190 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.794577 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.794938 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.795333 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.795710 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.796093 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.796470 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.796824 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.797234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.797598 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.797977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.798334 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.798692 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.799707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.800127 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.800724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.801137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.801532 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.801834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.802133 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.802517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.802899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.803268 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.803631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.803991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.804353 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.804716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.805092 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.805457 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.805818 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.806198 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.806572 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.806958 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.807319 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.807695 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.808172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.808472 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.808831 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.809260 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.809455 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 14 16:09:49.809644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.809806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 14 16:09:49.810012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.810390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.810772 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.811131 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.811310 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 14 16:09:49.811490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.811744 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 14 16:09:49.811849 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.812040 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 14 16:09:49.812199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.812504 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.812616 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.812876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.812980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.813205 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.813598 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.813716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.813817 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.813924 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.814036 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.814239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.814344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.814648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.814771 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.815176 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.815339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.815538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.815642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.815835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.815942 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.816200 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.816312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.816557 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.816668 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786266-1-iscsi {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.816918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.817065 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.817293 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.817410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.817643 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.817747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.817998 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.818102 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.818341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.818456 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.818692 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.818806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.819038 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.819146 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.819409 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.819664 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.819780 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.820020 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.820128 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.820371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.820488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.820726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.820840 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.821136 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.821246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.821501 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.821607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.821854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.821964 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.822216 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.822321 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.822562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.822667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.822928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.823042 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.823272 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.823384 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.823642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786266-1-iscsi {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.823757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.823994 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.824097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.824345 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.824457 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.824702 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.824842 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.825059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.825231 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.825428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.825540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.825806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.825925 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.826163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.826268 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.826520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.826636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.826873 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.826981 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.827219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.827324 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.827573 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.827747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.827929 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.828039 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.828282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.828387 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.828622 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.828735 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.828964 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.829087 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.829339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.829448 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.829706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.829826 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.830053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.830159 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.830431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.830542 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.830843 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.830992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.831194 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.831304 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.831566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.831678 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.831937 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.832048 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.832313 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.832418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.832604 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.832715 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.832892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.833108 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.833293 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.833503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.833663 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.833876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.834023 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.834243 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.834349 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.834610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.834741 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.834995 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.835104 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.835343 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.835458 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.835692 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.835800 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.836037 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.836143 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.836385 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.836490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.836751 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.836868 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.837125 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.837232 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.837500 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.837614 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.837851 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.837970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.838214 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.838319 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.838578 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.838683 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.838931 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.839048 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.839281 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.839388 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.839655 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.839760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.840019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.840161 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.840368 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.840482 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.840734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.840844 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.841124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.841243 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.841474 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.841584 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.841821 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.841925 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.842171 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.842276 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.842539 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.842645 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.842898 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.843009 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.843236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.843341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.843524 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.843640 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.843865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.843977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.844212 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.844317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.844585 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.844694 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.844933 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.845069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.845307 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.845421 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.845655 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.846311 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.846510 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.846803 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.847047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.847329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.847435 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.847540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.847641 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.847792 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.847912 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.848139 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.848253 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.848483 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.848588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.848830 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.848941 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.849235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.849349 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.849584 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.849700 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.849943 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.850048 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.850305 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.850410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.850652 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.850769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.851000 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.851111 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.851346 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.851457 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.851694 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.851807 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.852061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.852172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.852408 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.852519 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.852753 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.852869 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.853145 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.853266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.853494 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.853608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.853839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.853946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.854202 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.854318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.854540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.854652 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.854884 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.854989 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.855248 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.855366 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.855582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.855711 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.855929 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.856044 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.856295 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.856399 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.856640 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.856819 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.856987 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.857119 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.857356 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.857463 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.857698 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.857815 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.858040 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.858145 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.858383 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.858488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.858724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.858836 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.859064 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.859175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.859404 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.859516 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.859767 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.859881 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.860117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.860231 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.860458 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.860554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.860825 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.860940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.861169 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.861268 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.862159 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.862312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 14 16:09:49.862483 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.862579 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.862845 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.862957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.863227 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.863339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.863593 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.863706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.863953 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.864057 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.864311 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.864416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.864663 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.864768 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.865027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.865164 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.865407 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.865525 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.865781 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.865924 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.866135 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.866249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.866490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.866607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.866842 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.866946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.867201 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.867312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.867555 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.867673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.867907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.868012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.868266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.868372 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.868626 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.868743 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.868977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.869104 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.869359 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.869511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.869710 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.869824 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.870076 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.870190 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.870434 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.870571 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.870791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.870897 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.871161 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.871265 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.871528 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.871632 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.871880 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.871986 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.872247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.872664 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.872664 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.872915 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.873113 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.873247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.873363 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.873479 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.873623 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.873729 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.873951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.874062 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.874312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.874417 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.874669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.874782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.875026 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.875131 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.875386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.875498 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.875734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.875851 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.876096 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.876203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.876440 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.876547 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.876790 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.876902 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.877201 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.877316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.877620 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.877734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.877967 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.878085 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.878333 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.878437 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.878705 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.878811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.879048 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.879163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.879399 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.879510 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.879758 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.879908 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.880110 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.880217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.880464 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.880575 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.880806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.881057 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.881178 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.881430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.881543 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.881834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.881941 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.882192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.882332 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.882540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.882653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.882889 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.883002 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.883253 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.883371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.883602 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.883713 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.883954 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.884061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.884312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.884432 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.884659 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.884770 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.885020 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.885189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.885396 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.885503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.885769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.885874 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.886124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.886230 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.886476 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.886589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.886833 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.886938 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.887199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.887305 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.887544 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.887656 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.887920 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.888031 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.888281 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.888387 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.888636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.888742 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.888979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.889145 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.889361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.889474 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.889705 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.889817 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.890057 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.890407 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.890520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.890761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.890875 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.891109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.891220 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.891456 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.891563 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.891805 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.891911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.892155 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.892260 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.892513 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.892635 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.892927 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.893065 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.893320 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.893506 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.893681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.893858 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.894049 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.894209 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.894408 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.894555 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.894765 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.894954 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.895129 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.895309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.895490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.895700 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.895848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.896057 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.896208 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.896427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.896574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.896788 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.896933 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.897182 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.897327 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.897538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.897670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.897888 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.898012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.898602 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.898724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.898837 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.898949 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.899072 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.899186 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.899297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.899407 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.899530 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.899699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.899887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.900062 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.900254 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.900429 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.900636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.900776 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.901062 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.901183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.901433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.901546 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.901665 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.901900 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.902027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.902236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.902355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.902630 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.902736 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.902995 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.903099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.903344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.903457 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.903698 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.903803 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.904061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.904166 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.904410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.904522 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.904756 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.904867 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.905136 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.905246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.905495 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.905612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.905845 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.905956 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.906188 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.906303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.906538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.906649 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.906891 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.907003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.907240 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.907351 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.907589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.907695 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.907939 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.908054 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.908824 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.908939 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.909213 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.909333 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.909662 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.909768 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.910023 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.910135 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.910371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.910476 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.910976 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.911081 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.911328 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.911509 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.911714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.911860 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.912081 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.912264 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.912438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.912622 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.912814 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.912976 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.913164 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.913365 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.913524 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.913736 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.913891 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.914092 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.914275 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.914451 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.914646 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.914785 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.915006 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.915136 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.915373 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.915481 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.915732 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.915849 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.916091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.916238 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.916450 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.916557 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.916798 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.916913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.917172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.917282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.917520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.917626 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.917871 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.917977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.918218 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.918323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.918568 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.918681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.918913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.919030 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.919261 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.919366 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.919615 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.919726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.919965 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.920071 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.920324 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.920661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.920766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.921051 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.921171 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.921417 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.921522 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.921781 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.921886 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.922146 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.922285 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.922508 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.922614 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.922872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.922978 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.923231 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.923344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.923579 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.923690 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.923982 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.924599 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.924850 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.925116 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.925235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.925481 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.925587 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.925846 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.925965 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.926206 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.926312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.926554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.926669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.926904 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.927021 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.927259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.927370 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.927608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.927712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.927957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.928070 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.928304 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.928415 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.928656 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.928760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.929017 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.929151 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.929385 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.929501 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.929739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.929846 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.930088 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.930195 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.930448 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.930553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.930794 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.930905 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.931143 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.931257 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.931494 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.931607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.931841 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.931957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.932197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.932339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.932560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.932675 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.932917 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.933085 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.933303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.933409 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.933693 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.933806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.934053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.934171 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.934402 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.934516 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.934762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.934873 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.935104 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.935217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.935453 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.935559 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.935807 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.935918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.936156 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.936322 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.936504 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.936690 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.936856 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.937107 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.937230 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.937445 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.937559 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.937814 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.937920 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.938185 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.938298 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.938545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.938651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.938907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.939019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.939258 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.939370 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.939675 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.939788 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.940025 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.940136 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.940381 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.940494 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.940736 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.940847 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.941106 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.941228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.941484 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.941596 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.941838 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.941943 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.942188 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.942299 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.942542 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.942684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.942892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.943004 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.943237 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.943347 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.943588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.943700 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.943946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.944051 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.944304 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.944408 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.944652 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.944803 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.945005 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.945221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.945378 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.945583 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.945730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.946080 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.946185 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.946425 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.946536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.946773 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.946879 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.947121 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.947231 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.947468 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.947586 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.947814 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.947927 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.948160 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.948264 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.948534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.948638 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.948885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.948997 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.949260 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.949376 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.949609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.949713 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.949955 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.950068 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.950332 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.950442 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.950676 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.950792 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.951056 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.951201 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.951425 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.951537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.951786 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.951903 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.952152 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.952258 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.952510 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.952646 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.952861 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.952980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.953255 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.953364 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.953608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.953712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.953967 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.954079 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.954316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.954422 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.954663 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.954768 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.955034 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.955146 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.955414 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.955552 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.955770 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.955887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.956138 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.956291 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.956492 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.956641 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.956858 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.956963 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.957234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.957346 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.957589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.957700 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.957940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.958050 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.958289 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.958402 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.958645 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.958750 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.958998 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.959107 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.959348 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.959460 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.959706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.959812 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.960063 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.960175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.960418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.960530 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.960774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.960879 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.961142 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.961265 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.961500 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.961612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.961855 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.961960 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.962204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.962316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.962563 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.962667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.962911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.963041 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.963260 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.963374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.963611 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.963720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.963960 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.964065 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.964312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.964429 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.964662 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.964775 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.965095 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.965203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.965483 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.965589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.965857 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.965970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.966199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.966295 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.966553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.966648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.966908 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.967065 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.967259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.967389 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.967612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.967717 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.967960 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.968065 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.968311 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.968450 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.968670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.968809 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.969075 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.969193 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.969410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.969521 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.969771 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.969876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.970130 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.970241 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.970493 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.970605 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.971365 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.971531 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.971748 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.971987 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.972097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.972281 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.972449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.972634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.972811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.973011 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.973215 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.973386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.973623 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.973727 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.973983 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.974218 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.974376 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.974574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.974750 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.974923 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.975130 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.975409 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.975523 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.975767 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.975872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.976129 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.976240 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.976504 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.976620 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.976878 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.976988 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.977268 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.977376 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.977612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.977734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.977973 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.978079 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.978329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.978441 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.978689 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.978802 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.979054 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.979158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.979400 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.979511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.979763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.979868 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.980115 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.980219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.980490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.980743 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.980855 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.981169 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.981289 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.981542 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.981648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.981908 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.982020 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.982273 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.982378 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.982646 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.982751 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.983011 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.983128 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.983375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.983485 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.983727 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.983860 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.984080 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.984193 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.984440 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.984546 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.984791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.984902 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.985183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.985293 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.985565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.985681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.985923 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.986029 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.986280 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.986432 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.986763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.986887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.987124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.987266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.987479 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.987584 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.987835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.987947 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.988209 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.988320 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.988560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.988665 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.988927 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.989063 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.989310 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.989425 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.989682 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.989787 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.990051 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.990156 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.990404 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.990508 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.990769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.990873 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.991117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.991243 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.991472 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.991606 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.991826 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.991948 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.992171 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.992278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.992533 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.992648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.992887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.993001 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.993279 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.993418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.993661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.993773 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.994022 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.994136 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.994374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.994502 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.994747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.994860 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.995111 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.995359 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.995474 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.995730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.995826 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.996124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.996237 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.996483 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.996589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.996833 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.996940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.997217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.997348 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.997567 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.997677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.997916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.998025 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.998266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.998381 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.998619 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.998731 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.998961 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.999072 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.999310 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.999428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.999658 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:49.999769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.000031 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.000136 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.000382 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.000528 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.000741 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.000860 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.001109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.001219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.001691 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.001820 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.002445 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.002653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.002769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.003054 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.003306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.003441 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.003690 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.003804 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.004082 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.004193 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.004451 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.004567 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.004825 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.004934 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.005199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.005307 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.005576 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.005683 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.005935 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.006048 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.006295 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.006407 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.006655 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.006768 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.007016 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.007121 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.007369 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.007525 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.007722 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.007831 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.008080 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.008252 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.008426 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.008543 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.008782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.008888 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.009157 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.009267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.009514 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.009630 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.009902 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.010119 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.010266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.010492 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.010603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.010851 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.010970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.011207 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.011312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.011565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.011676 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.011930 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.012043 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.012285 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.012390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.012640 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.012756 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.012999 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.013134 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.013383 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.013512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.013731 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.013879 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.014086 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.014262 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.014456 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.014562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.014816 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.014928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.015184 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.015291 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.015533 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.015645 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.015891 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.016003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.016249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.016360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.016602 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.016713 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.016966 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.017117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.017362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.017467 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.017757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.017865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.018128 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.018283 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.018481 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.018587 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.018838 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.018950 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.019196 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.019303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.019557 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.019830 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.019935 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.020225 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.020401 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.020584 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.020689 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.020940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.021076 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.021324 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.021431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.021681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.021787 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.022052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.022164 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.022413 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.022521 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.022771 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.022877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.023127 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.023243 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.023482 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.023615 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.023841 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.023956 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.024207 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.024426 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.024574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.024787 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.024940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.025196 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.025356 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.025570 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.025684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.025942 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.026080 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.026306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.026480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.026667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.026779 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.027045 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.027158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.027397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.027511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.027748 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.027863 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.028104 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.028241 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.028458 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.028578 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.028806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.028911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.029205 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.029331 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.029564 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.029684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.029913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.030019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.030278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.030383 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.030632 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.030803 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.030983 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.031250 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.031488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.031655 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.031872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.032006 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.032236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.032355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.032613 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.032720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.032980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.033133 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.033918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.034103 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.034318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.034423 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.034701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.034859 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.035055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.035161 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.035420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.035785 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.036028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.036167 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.036378 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.036491 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.036728 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.036842 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.037103 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.037212 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.037461 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.037567 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.037812 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.037924 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.038167 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.038274 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.038517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.038631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.038890 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.039007 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.039241 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.039355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.039591 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.039697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.039942 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.040055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.040296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.040409 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.040643 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.040755 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.040994 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.041152 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.041371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.041480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.041721 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.041826 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.042078 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.042184 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.042425 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.042530 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.042778 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.042884 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.043130 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.043236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.043479 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.043585 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.043829 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.043959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.044184 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.044337 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.044534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.044639 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.044907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.045020 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.045284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.045401 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.045637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.045742 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.046004 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.046126 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.046360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.046472 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.046729 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.046877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.047084 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.047189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.047440 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.047554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.047799 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.047915 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.048172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.048277 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.048531 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.048804 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.049029 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.049221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.049430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.049592 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.049799 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.049991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.050170 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.050382 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.050539 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.050737 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.050930 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.051091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.051327 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.051432 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.051686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.051797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.052070 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.052175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.052439 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.052551 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.052794 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.052907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.053174 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.053298 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.053530 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.053635 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.053884 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.053991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.054239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.054388 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.054595 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.054701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.054948 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.055093 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.055305 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.055475 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.055677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.055790 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.056036 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.056142 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.056396 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.056508 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.056756 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.056862 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.057137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.057244 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.057495 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.057602 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.057849 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.057960 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.058202 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.058317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.058554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.058684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.058912 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.059029 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.059228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99335) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 14 16:09:50.059334 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.059621 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.059970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.060455 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.060811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.061196 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.061564 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.061918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.062296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.062683 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.063061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.063452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.063802 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.064151 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.065062 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.065428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.065832 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.066232 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.066597 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.066971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.067351 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.067714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.068073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.068432 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.068787 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.069166 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.069532 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.069894 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.070260 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.070616 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.070990 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.071344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.071707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.072057 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.072417 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.072772 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.073156 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.073540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.073896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.074267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.074622 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.074992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.075343 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.075714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.076091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.076449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.076799 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.077205 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.077562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.077918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.078273 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.078628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.078985 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.079341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.079720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.080139 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.080496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.080874 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.081263 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.081631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.081993 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.082347 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.082727 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.083081 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.083438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.083791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.084143 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.084501 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.089148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.089148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.089148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.089148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.089148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.089148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.089148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.089148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.089957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:09:50.089957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99334) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 14 16:09:50.095277 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_db.sqlalchemy.engines [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99335) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:09:50.123838 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_db.sqlalchemy.engines [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99334) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:09:50.365589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.context [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),967aa7b0-fa4e-4888-a21e-20a4679b0859(cell1) {{(pid=99335) load_cells /opt/stack/nova/nova/context.py:466}} Apr 14 16:09:50.371115 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:09:50.373008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:09:50.373947 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:09:50.376130 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:09:50.394311 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.context [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),967aa7b0-fa4e-4888-a21e-20a4679b0859(cell1) {{(pid=99334) load_cells /opt/stack/nova/nova/context.py:466}} Apr 14 16:09:50.399828 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:09:50.401743 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:09:50.402292 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_db.sqlalchemy.engines [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99335) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:09:50.402665 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:09:50.403204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_db.sqlalchemy.engines [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99335) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:09:50.404837 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:09:50.431913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_db.sqlalchemy.engines [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99334) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:09:50.432815 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_db.sqlalchemy.engines [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99334) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:09:50.435259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_db.sqlalchemy.engines [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99335) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:09:50.464211 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_db.sqlalchemy.engines [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99334) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 14 16:09:50.522712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 14 16:09:50.522712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: from cryptography.utils import int_from_bytes Apr 14 16:09:50.523071 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 14 16:09:50.523071 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: from cryptography.utils import int_from_bytes Apr 14 16:09:50.546520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 14 16:09:50.546520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: from cryptography.utils import int_from_bytes Apr 14 16:09:50.546906 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 14 16:09:50.546906 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: from cryptography.utils import int_from_bytes Apr 14 16:09:50.606303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO keyring.backend [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] Loading Gnome Apr 14 16:09:50.624082 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO keyring.backend [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] Loading Gnome Apr 14 16:09:50.628198 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO keyring.backend [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] Loading Google Apr 14 16:09:50.631809 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO keyring.backend [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] Loading Windows (alt) Apr 14 16:09:50.637848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO keyring.backend [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] Loading file Apr 14 16:09:50.639124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO keyring.backend [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] Loading keyczar Apr 14 16:09:50.639579 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO keyring.backend [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] Loading multi Apr 14 16:09:50.640460 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO keyring.backend [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] Loading pyfs Apr 14 16:09:50.645451 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO keyring.backend [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] Loading Google Apr 14 16:09:50.648820 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO keyring.backend [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] Loading Windows (alt) Apr 14 16:09:50.653607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO keyring.backend [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] Loading file Apr 14 16:09:50.654843 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO keyring.backend [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] Loading keyczar Apr 14 16:09:50.655298 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO keyring.backend [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] Loading multi Apr 14 16:09:50.656172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO keyring.backend [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] Loading pyfs Apr 14 16:09:50.937017 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: WARNING keystonemiddleware.auth_token [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 16:09:50.941345 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: WARNING keystonemiddleware.auth_token [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 16:09:50.944974 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: WARNING keystonemiddleware.auth_token [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 16:09:50.948835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: WARNING keystonemiddleware.auth_token [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 16:09:51.297904 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: WARNING keystonemiddleware.auth_token [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 16:09:51.303674 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: WARNING keystonemiddleware.auth_token [None req-45e3f175-a73c-41e1-81a2-f682240bf113 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 16:09:51.304442 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: WARNING keystonemiddleware.auth_token [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 16:09:51.309437 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55793194d9c0 pid: 99335 (default app) Apr 14 16:09:51.310183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: WARNING keystonemiddleware.auth_token [None req-dc6deac4-9690-4195-87e0-9dae0a412dd0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 16:09:51.316416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55793194d9c0 pid: 99334 (default app) Apr 14 16:10:35.798747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-642690152", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452", "networks": [{"uuid": "dd979b70-9f85-4020-9a3c-e29dec5a7332"}]}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:10:36.257721 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] validate_networks() for [('dd979b70-9f85-4020-9a3c-e29dec5a7332', None, None, None)] {{(pid=99335) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:10:37.764297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1595163680", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452", "networks": [{"uuid": "2513cfaf-5700-4daa-9c93-a6579fd80809"}]}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:10:38.183540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] validate_networks() for [('2513cfaf-5700-4daa-9c93-a6579fd80809', None, None, None)] {{(pid=99334) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:10:39.428320 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Flavor limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:10:39.428821 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Image limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:10:39.429364 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Flavor pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:10:39.429818 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Image pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:10:39.430716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:10:39.455343 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:39.455856 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:39.456714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:39.464240 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:39.518975 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Getting quotas for project 2d2d21c1e64e48cf923ecf68d5af1695. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:10:39.535466 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Getting quotas for user 34dc00fb264645ee9968186a4aa9a7cf and project 2d2d21c1e64e48cf923ecf68d5af1695. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:10:39.564543 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Going to run 1 instances... {{(pid=99335) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:10:39.580415 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:10:39.798448 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0fb5b7bd-1bda-4466-a946-70a85796a009 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.783253 Apr 14 16:10:39.799468 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:10:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 4786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:10:39.811732 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0ec2d12c-ada1-4214-9d57-2468942a11b3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:39.812398 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0ec2d12c-ada1-4214-9d57-2468942a11b3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:40.441191 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0ec2d12c-ada1-4214-9d57-2468942a11b3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:40.459504 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0ec2d12c-ada1-4214-9d57-2468942a11b3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1214 microversion: 2.1 time: 0.652278 Apr 14 16:10:40.463393 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 2/2] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:39 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1214 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:10:41.258104 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Flavor limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:10:41.258845 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Image limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:10:41.259616 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Flavor pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:10:41.260315 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Image pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:10:41.260980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:10:41.297352 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:41.302526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:41.303705 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:41.304573 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:41.360734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Getting quotas for project b8a4298bacf14cd493bcec2e3543ab00. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:10:41.367097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Getting quotas for user 8a19cff22a01451e8d454b8a8f4cde89 and project b8a4298bacf14cd493bcec2e3543ab00. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:10:41.385825 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Going to run 1 instances... {{(pid=99334) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:10:41.391120 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:10:41.481804 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a4cd0ff2-80e9-4769-a21b-b6bfd4c64563 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:41.483085 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a4cd0ff2-80e9-4769-a21b-b6bfd4c64563 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:41.562093 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c9ea2a06-d3c5-4cd5-bc3e-e3b2e7ae056d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.335532 Apr 14 16:10:41.562819 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:10:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 4338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:10:41.580778 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e08d3fd2-1413-4144-a41a-003489bd103d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:41.581729 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e08d3fd2-1413-4144-a41a-003489bd103d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:41.871175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a4cd0ff2-80e9-4769-a21b-b6bfd4c64563 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:41.886569 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a4cd0ff2-80e9-4769-a21b-b6bfd4c64563 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1214 microversion: 2.1 time: 0.408541 Apr 14 16:10:41.889848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 3/4] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:41 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1214 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:10:42.173252 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e08d3fd2-1413-4144-a41a-003489bd103d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:42.191759 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e08d3fd2-1413-4144-a41a-003489bd103d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1218 microversion: 2.1 time: 0.620732 Apr 14 16:10:42.192405 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 2/5] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:41 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1218 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:10:42.909100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f95e89d8-3a1d-483c-ab37-9554ae57be0b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:42.910752 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f95e89d8-3a1d-483c-ab37-9554ae57be0b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:42.934606 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f95e89d8-3a1d-483c-ab37-9554ae57be0b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:42.937380 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f95e89d8-3a1d-483c-ab37-9554ae57be0b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:42.940244 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f95e89d8-3a1d-483c-ab37-9554ae57be0b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:42.942062 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f95e89d8-3a1d-483c-ab37-9554ae57be0b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:43.211437 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c98b5fa5-b1c3-47cd-954a-4a838672d786 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:43.212254 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c98b5fa5-b1c3-47cd-954a-4a838672d786 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:43.253251 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c98b5fa5-b1c3-47cd-954a-4a838672d786 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:43.259622 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c98b5fa5-b1c3-47cd-954a-4a838672d786 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:43.262580 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c98b5fa5-b1c3-47cd-954a-4a838672d786 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:43.267685 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c98b5fa5-b1c3-47cd-954a-4a838672d786 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:43.363929 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f95e89d8-3a1d-483c-ab37-9554ae57be0b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:43.389445 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f95e89d8-3a1d-483c-ab37-9554ae57be0b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1266 microversion: 2.1 time: 0.486351 Apr 14 16:10:43.404812 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 4/6] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:42 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1266 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:10:44.431214 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c874d6cc-7b9e-428d-b018-400095b2f89d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:44.431894 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c874d6cc-7b9e-428d-b018-400095b2f89d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:44.453839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c874d6cc-7b9e-428d-b018-400095b2f89d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:44.454649 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c874d6cc-7b9e-428d-b018-400095b2f89d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:44.456046 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c874d6cc-7b9e-428d-b018-400095b2f89d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:44.456704 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c874d6cc-7b9e-428d-b018-400095b2f89d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:44.486266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c98b5fa5-b1c3-47cd-954a-4a838672d786 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:44.501414 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c98b5fa5-b1c3-47cd-954a-4a838672d786 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1214 microversion: 2.1 time: 1.294360 Apr 14 16:10:44.523481 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 3/7] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:43 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1214 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:10:45.130676 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c874d6cc-7b9e-428d-b018-400095b2f89d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:45.144397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c874d6cc-7b9e-428d-b018-400095b2f89d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1272 microversion: 2.1 time: 0.719723 Apr 14 16:10:45.145461 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 5/8] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:44 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1272 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:10:45.532560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c1df0bf1-aabd-4347-bada-8f6ddcc0bc50 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:45.534983 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c1df0bf1-aabd-4347-bada-8f6ddcc0bc50 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:45.558441 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1df0bf1-aabd-4347-bada-8f6ddcc0bc50 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:45.569541 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1df0bf1-aabd-4347-bada-8f6ddcc0bc50 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:45.570816 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1df0bf1-aabd-4347-bada-8f6ddcc0bc50 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:45.572984 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1df0bf1-aabd-4347-bada-8f6ddcc0bc50 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:46.164074 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b46b810f-4533-4cac-9a4a-bd0a484036d3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:46.165165 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b46b810f-4533-4cac-9a4a-bd0a484036d3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:46.182385 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b46b810f-4533-4cac-9a4a-bd0a484036d3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:46.186169 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b46b810f-4533-4cac-9a4a-bd0a484036d3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:46.187678 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b46b810f-4533-4cac-9a4a-bd0a484036d3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:46.189791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b46b810f-4533-4cac-9a4a-bd0a484036d3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:46.288698 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c1df0bf1-aabd-4347-bada-8f6ddcc0bc50 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:46.305969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c1df0bf1-aabd-4347-bada-8f6ddcc0bc50 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1276 microversion: 2.1 time: 0.774983 Apr 14 16:10:46.337008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 4/9] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:45 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1276 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:10:47.310687 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b46b810f-4533-4cac-9a4a-bd0a484036d3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:47.324192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0ee63188-d434-461c-ad59-33c67e20f92d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:47.325460 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0ee63188-d434-461c-ad59-33c67e20f92d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:47.334651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b46b810f-4533-4cac-9a4a-bd0a484036d3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1272 microversion: 2.1 time: 1.174454 Apr 14 16:10:47.339391 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0ee63188-d434-461c-ad59-33c67e20f92d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:47.350418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 6/10] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:46 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1272 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:10:47.351384 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0ee63188-d434-461c-ad59-33c67e20f92d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:47.352511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0ee63188-d434-461c-ad59-33c67e20f92d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:47.353272 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0ee63188-d434-461c-ad59-33c67e20f92d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:48.361098 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-43434911-c7de-41ca-a490-fea0c5281522 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:48.362381 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-43434911-c7de-41ca-a490-fea0c5281522 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:48.381893 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43434911-c7de-41ca-a490-fea0c5281522 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:48.387025 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43434911-c7de-41ca-a490-fea0c5281522 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:48.389828 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43434911-c7de-41ca-a490-fea0c5281522 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:48.391658 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43434911-c7de-41ca-a490-fea0c5281522 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:49.315492 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-43434911-c7de-41ca-a490-fea0c5281522 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:49.332654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-43434911-c7de-41ca-a490-fea0c5281522 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1272 microversion: 2.1 time: 0.976067 Apr 14 16:10:49.336100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 7/11] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:48 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1272 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:10:49.496814 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0ee63188-d434-461c-ad59-33c67e20f92d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:49.521988 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0ee63188-d434-461c-ad59-33c67e20f92d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1276 microversion: 2.1 time: 2.198251 Apr 14 16:10:49.523072 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 5/12] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:47 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1276 bytes in 2203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:10:50.152479 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-80d09285-7a37-4664-b2e2-b24ccf038da5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'create', calling method: .version_select at 0x7ff58e9d47b8>, body: {"keypair": {"name": "tempest-keypair-1214528804"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:10:50.223927 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-80d09285-7a37-4664-b2e2-b24ccf038da5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Getting quotas for project 7c32c45b97f24aafbfc72c32f2ee651f. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:10:50.237553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-80d09285-7a37-4664-b2e2-b24ccf038da5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Getting quotas for user 01801b3a85a648fb94444e671cbb4d18 and project 7c32c45b97f24aafbfc72c32f2ee651f. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:10:50.354323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-23215361-82ad-4662-81d5-4e219e130dd9 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:50.355157 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-23215361-82ad-4662-81d5-4e219e130dd9 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:50.371341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23215361-82ad-4662-81d5-4e219e130dd9 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:50.385732 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23215361-82ad-4662-81d5-4e219e130dd9 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:50.387025 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23215361-82ad-4662-81d5-4e219e130dd9 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:50.387798 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23215361-82ad-4662-81d5-4e219e130dd9 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:51.250520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-80d09285-7a37-4664-b2e2-b24ccf038da5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Getting quotas for project 7c32c45b97f24aafbfc72c32f2ee651f. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:10:51.258961 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-80d09285-7a37-4664-b2e2-b24ccf038da5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Getting quotas for user 01801b3a85a648fb94444e671cbb4d18 and project 7c32c45b97f24aafbfc72c32f2ee651f. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:10:51.290622 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-80d09285-7a37-4664-b2e2-b24ccf038da5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.951777 Apr 14 16:10:51.295908 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 8/13] 10.222.0.60 () {62 vars in 1189 bytes} [Wed Apr 14 16:10:49 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1959 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 14 16:10:51.301223 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fc1812c6-ce92-4edd-a0b7-85bb40b3edc5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:51.305367 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fc1812c6-ce92-4edd-a0b7-85bb40b3edc5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:51.323533 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fc1812c6-ce92-4edd-a0b7-85bb40b3edc5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:51.325410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fc1812c6-ce92-4edd-a0b7-85bb40b3edc5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:51.328730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fc1812c6-ce92-4edd-a0b7-85bb40b3edc5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:51.329452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fc1812c6-ce92-4edd-a0b7-85bb40b3edc5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:53.217634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fc1812c6-ce92-4edd-a0b7-85bb40b3edc5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:53.232333 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fc1812c6-ce92-4edd-a0b7-85bb40b3edc5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1318 microversion: 2.1 time: 1.934377 Apr 14 16:10:53.235533 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 9/14] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:51 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1318 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:10:53.862411 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-23215361-82ad-4662-81d5-4e219e130dd9 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:53.883264 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-23215361-82ad-4662-81d5-4e219e130dd9 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1314 microversion: 2.1 time: 3.532908 Apr 14 16:10:53.889106 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 6/15] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:50 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1314 bytes in 3535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:10:54.251797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ca65531b-7208-47ae-acb7-6c5ebe55c454 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:54.253004 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ca65531b-7208-47ae-acb7-6c5ebe55c454 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:54.279397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ca65531b-7208-47ae-acb7-6c5ebe55c454 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:54.280747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ca65531b-7208-47ae-acb7-6c5ebe55c454 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:54.293623 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ca65531b-7208-47ae-acb7-6c5ebe55c454 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:54.295057 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ca65531b-7208-47ae-acb7-6c5ebe55c454 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:54.903068 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0b3c5b95-b31c-4a5b-9843-1ba1ee16d09f tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:54.904028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0b3c5b95-b31c-4a5b-9843-1ba1ee16d09f tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:54.922105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0b3c5b95-b31c-4a5b-9843-1ba1ee16d09f tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:54.924117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0b3c5b95-b31c-4a5b-9843-1ba1ee16d09f tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:54.928650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0b3c5b95-b31c-4a5b-9843-1ba1ee16d09f tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:54.929401 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0b3c5b95-b31c-4a5b-9843-1ba1ee16d09f tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:55.154263 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ca65531b-7208-47ae-acb7-6c5ebe55c454 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:55.183234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ca65531b-7208-47ae-acb7-6c5ebe55c454 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1318 microversion: 2.1 time: 0.935523 Apr 14 16:10:55.189250 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 10/16] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:54 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1318 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:10:56.207114 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cd40cdda-b88a-4231-b6db-0b127b04902e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:56.209237 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cd40cdda-b88a-4231-b6db-0b127b04902e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:56.226850 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd40cdda-b88a-4231-b6db-0b127b04902e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:56.229524 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd40cdda-b88a-4231-b6db-0b127b04902e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:56.232830 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd40cdda-b88a-4231-b6db-0b127b04902e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:56.239667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd40cdda-b88a-4231-b6db-0b127b04902e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:57.388107 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0b3c5b95-b31c-4a5b-9843-1ba1ee16d09f tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:57.424074 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0b3c5b95-b31c-4a5b-9843-1ba1ee16d09f tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1314 microversion: 2.1 time: 2.525497 Apr 14 16:10:57.438096 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 7/17] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:54 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1314 bytes in 2540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:10:58.443055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-abb17ede-e0b3-4e0d-aa54-36d57e142d55 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:58.443945 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-abb17ede-e0b3-4e0d-aa54-36d57e142d55 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:58.466747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-abb17ede-e0b3-4e0d-aa54-36d57e142d55 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:58.467406 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-abb17ede-e0b3-4e0d-aa54-36d57e142d55 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:58.478369 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-abb17ede-e0b3-4e0d-aa54-36d57e142d55 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:58.479001 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-abb17ede-e0b3-4e0d-aa54-36d57e142d55 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:58.661540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cd40cdda-b88a-4231-b6db-0b127b04902e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:58.676864 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cd40cdda-b88a-4231-b6db-0b127b04902e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1318 microversion: 2.1 time: 2.473894 Apr 14 16:10:58.678116 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 11/18] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:56 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1318 bytes in 2476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:10:59.661607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-abb17ede-e0b3-4e0d-aa54-36d57e142d55 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:10:59.673375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-abb17ede-e0b3-4e0d-aa54-36d57e142d55 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1314 microversion: 2.1 time: 1.235074 Apr 14 16:10:59.674560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 8/19] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:58 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1314 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:10:59.696930 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-be217980-549b-456e-b731-8c6183e1467a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:10:59.701703 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-be217980-549b-456e-b731-8c6183e1467a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:10:59.710732 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-be217980-549b-456e-b731-8c6183e1467a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:59.711369 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-be217980-549b-456e-b731-8c6183e1467a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:10:59.712545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-be217980-549b-456e-b731-8c6183e1467a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:10:59.713315 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-be217980-549b-456e-b731-8c6183e1467a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:00.695278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-efe08d84-790f-4d11-9868-1fa2f2aa60b3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:00.695945 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-efe08d84-790f-4d11-9868-1fa2f2aa60b3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:00.712406 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-efe08d84-790f-4d11-9868-1fa2f2aa60b3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:00.713107 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-efe08d84-790f-4d11-9868-1fa2f2aa60b3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:00.713967 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-efe08d84-790f-4d11-9868-1fa2f2aa60b3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:00.714454 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-efe08d84-790f-4d11-9868-1fa2f2aa60b3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:01.587035 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-efe08d84-790f-4d11-9868-1fa2f2aa60b3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:01.605335 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-efe08d84-790f-4d11-9868-1fa2f2aa60b3 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1314 microversion: 2.1 time: 0.913647 Apr 14 16:11:01.607128 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 9/20] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:00 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1314 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:01.974318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-be217980-549b-456e-b731-8c6183e1467a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:01.989719 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-be217980-549b-456e-b731-8c6183e1467a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1318 microversion: 2.1 time: 2.296734 Apr 14 16:11:01.990596 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 12/21] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:10:59 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1318 bytes in 2299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:02.420231 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-345882323", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1543812-41fe-4295-b0c3-e4201c886b18"}], "security_groups": [{"name": "tempest-securitygroup--1021175754"}], "key_name": "tempest-keypair-1214528804", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:02.717641 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1713582508", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "adcbfc8b-7eee-4f76-a3ae-c2c3e4974f9c"}]}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:02.891835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] validate_networks() for [('adcbfc8b-7eee-4f76-a3ae-c2c3e4974f9c', None, None, None)] {{(pid=99335) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:11:03.115077 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] validate_networks() for [('b1543812-41fe-4295-b0c3-e4201c886b18', None, None, None)] {{(pid=99334) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:11:04.575701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Flavor limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:11:04.577214 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Image limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:11:04.578348 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Flavor pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:11:04.579026 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Image pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:11:04.582656 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:11:04.607081 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:04.611180 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:04.615069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:04.616174 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:04.671921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Getting quotas for project 7c32c45b97f24aafbfc72c32f2ee651f. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:11:04.681836 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Getting quotas for user 01801b3a85a648fb94444e671cbb4d18 and project 7c32c45b97f24aafbfc72c32f2ee651f. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:11:04.709628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Going to run 1 instances... {{(pid=99334) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:11:04.714297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:11:04.818550 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bd006e09-b1d5-4e47-9b22-f488ff7d143d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.400683 Apr 14 16:11:04.829906 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 10/22] 10.222.0.60 () {62 vars in 1178 bytes} [Wed Apr 14 16:11:02 2021] POST /compute/v2.1/servers => generated 402 bytes in 2416 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 14 16:11:04.845168 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5a0b2083-1d82-4db5-8a9a-10cef140a4ca tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:04.846866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5a0b2083-1d82-4db5-8a9a-10cef140a4ca tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:04.861001 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a0b2083-1d82-4db5-8a9a-10cef140a4ca tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:04.861991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a0b2083-1d82-4db5-8a9a-10cef140a4ca tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:04.862994 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a0b2083-1d82-4db5-8a9a-10cef140a4ca tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:04.863631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a0b2083-1d82-4db5-8a9a-10cef140a4ca tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:05.564526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5a0b2083-1d82-4db5-8a9a-10cef140a4ca tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:05.576410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5a0b2083-1d82-4db5-8a9a-10cef140a4ca tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1314 microversion: 2.1 time: 0.742715 Apr 14 16:11:05.586110 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 11/23] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:04 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1314 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:05.615360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c8eacc36-8b9a-4001-a348-d66bbcfa9a95 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:05.616178 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c8eacc36-8b9a-4001-a348-d66bbcfa9a95 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:05.634246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c8eacc36-8b9a-4001-a348-d66bbcfa9a95 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:05.634754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c8eacc36-8b9a-4001-a348-d66bbcfa9a95 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:05.635596 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c8eacc36-8b9a-4001-a348-d66bbcfa9a95 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:05.636229 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c8eacc36-8b9a-4001-a348-d66bbcfa9a95 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:06.264556 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c8eacc36-8b9a-4001-a348-d66bbcfa9a95 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:06.277439 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c8eacc36-8b9a-4001-a348-d66bbcfa9a95 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1318 microversion: 2.1 time: 0.689903 Apr 14 16:11:06.279622 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 12/24] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:05 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1318 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:06.624725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Flavor limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:11:06.626046 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Image limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:11:06.626931 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Flavor pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:11:06.627601 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Image pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:11:06.628508 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:11:06.654520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:06.658556 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:06.660840 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:06.662834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:06.724811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Getting quotas for project 3ef0238a8f524a30a94d06aa25d272f8. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:11:06.735475 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Getting quotas for user 530f5df43ffe47f68faced876280447a and project 3ef0238a8f524a30a94d06aa25d272f8. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:11:06.797968 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Going to run 1 instances... {{(pid=99335) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:11:06.806112 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:11:06.842672 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-850248be-50e0-4c08-84c5-32c934f555ac req-cdf6e38c-1995-4459-9ffa-034d903abd34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e0bacb9-233d-4561-9882-6c9619a84e69", "tag": "a6efdcb1-cac1-4a1b-88d3-3d4a36081e9f"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:06.845073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:06.845073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:06.878952 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-850248be-50e0-4c08-84c5-32c934f555ac req-cdf6e38c-1995-4459-9ffa-034d903abd34 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:06.879457 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-850248be-50e0-4c08-84c5-32c934f555ac req-cdf6e38c-1995-4459-9ffa-034d903abd34 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:06.963554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2c01b2b4-a45c-4ab0-84df-31f31ddacc3b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.503513 Apr 14 16:11:06.968139 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 13/25] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:11:02 2021] POST /compute/v2.1/servers => generated 383 bytes in 4514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:11:06.987583 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-850248be-50e0-4c08-84c5-32c934f555ac req-cdf6e38c-1995-4459-9ffa-034d903abd34 service nova] Creating event network-changed:a6efdcb1-cac1-4a1b-88d3-3d4a36081e9f for instance 3e0bacb9-233d-4561-9882-6c9619a84e69 on hv-cinder-78626 Apr 14 16:11:06.988127 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-850248be-50e0-4c08-84c5-32c934f555ac req-cdf6e38c-1995-4459-9ffa-034d903abd34 service nova] Acquired lock "compute-rpcapi-router" {{(pid=99334) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 14 16:11:06.990006 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4842dd1e-55f4-4f39-9568-2db41a610a44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:06.990688 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4842dd1e-55f4-4f39-9568-2db41a610a44 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:06.992099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4842dd1e-55f4-4f39-9568-2db41a610a44 None None] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:06.992742 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4842dd1e-55f4-4f39-9568-2db41a610a44 None None] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:07.025437 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.compute.rpcapi [None req-4842dd1e-55f4-4f39-9568-2db41a610a44 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 14 16:11:07.027040 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4842dd1e-55f4-4f39-9568-2db41a610a44 None None] Releasing lock "compute-rpcapi-router" {{(pid=99334) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 14 16:11:07.103294 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4842dd1e-55f4-4f39-9568-2db41a610a44 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.822088 Apr 14 16:11:07.103936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 13/26] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:07.110248 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bd07664b-549b-4be7-9146-32afb59127d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:07.123283 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bd07664b-549b-4be7-9146-32afb59127d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:07.167906 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd07664b-549b-4be7-9146-32afb59127d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:07.168452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd07664b-549b-4be7-9146-32afb59127d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:07.169548 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd07664b-549b-4be7-9146-32afb59127d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:07.180134 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd07664b-549b-4be7-9146-32afb59127d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:07.572760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3a160912-3f75-4fbd-9064-f3bffc8df19a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'create', calling method: .version_select at 0x7ff58e9d47b8>, body: {"keypair": {"name": "tempest-keypair-555153971"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:07.659811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-3a160912-3f75-4fbd-9064-f3bffc8df19a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Getting quotas for project 933c87bdb5354dc39f728c1bc6dfd17e. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:11:07.678972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-3a160912-3f75-4fbd-9064-f3bffc8df19a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Getting quotas for user 041bede4dd8e421c939c6fd868ac654e and project 933c87bdb5354dc39f728c1bc6dfd17e. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:11:07.922375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bd07664b-549b-4be7-9146-32afb59127d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:07.947295 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bd07664b-549b-4be7-9146-32afb59127d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:07.958470 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bd07664b-549b-4be7-9146-32afb59127d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:07.959739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bd07664b-549b-4be7-9146-32afb59127d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1351 microversion: 2.20 time: 0.854113 Apr 14 16:11:07.980061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 14/27] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:11:07 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1351 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:11:07.996853 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a3c4d9ef-ad15-4cd0-abe2-90ca0b81cd68 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:08.004453 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a3c4d9ef-ad15-4cd0-abe2-90ca0b81cd68 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:08.036718 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a3c4d9ef-ad15-4cd0-abe2-90ca0b81cd68 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:08.038688 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a3c4d9ef-ad15-4cd0-abe2-90ca0b81cd68 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:08.040363 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a3c4d9ef-ad15-4cd0-abe2-90ca0b81cd68 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:08.042001 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a3c4d9ef-ad15-4cd0-abe2-90ca0b81cd68 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:08.597255 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-3a160912-3f75-4fbd-9064-f3bffc8df19a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Getting quotas for project 933c87bdb5354dc39f728c1bc6dfd17e. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:11:08.604865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-3a160912-3f75-4fbd-9064-f3bffc8df19a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Getting quotas for user 041bede4dd8e421c939c6fd868ac654e and project 933c87bdb5354dc39f728c1bc6dfd17e. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:11:08.655192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3a160912-3f75-4fbd-9064-f3bffc8df19a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.685811 Apr 14 16:11:08.659090 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 14/28] 10.222.0.60 () {60 vars in 1148 bytes} [Wed Apr 14 16:11:06 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:08.674787 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1e62db59-dea1-4fff-89c5-6fa58c61c3e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:08.675525 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1e62db59-dea1-4fff-89c5-6fa58c61c3e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:08.709439 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e62db59-dea1-4fff-89c5-6fa58c61c3e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:08.711055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e62db59-dea1-4fff-89c5-6fa58c61c3e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:08.711867 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e62db59-dea1-4fff-89c5-6fa58c61c3e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:08.712374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e62db59-dea1-4fff-89c5-6fa58c61c3e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:09.431593 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a3c4d9ef-ad15-4cd0-abe2-90ca0b81cd68 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:09.445896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1e62db59-dea1-4fff-89c5-6fa58c61c3e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:09.456604 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a3c4d9ef-ad15-4cd0-abe2-90ca0b81cd68 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1314 microversion: 2.1 time: 1.464785 Apr 14 16:11:09.457358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 15/29] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:07 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1314 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:09.466308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1e62db59-dea1-4fff-89c5-6fa58c61c3e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1274 microversion: 2.1 time: 0.805429 Apr 14 16:11:09.467457 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 15/30] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:08 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1274 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:09.477491 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6ca0cddb-3367-4a76-86e4-d3ee547670f6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:09.478175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6ca0cddb-3367-4a76-86e4-d3ee547670f6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:09.495302 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cee7a2e0-6d1b-4441-ba2d-34f79dd94896 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:09.498514 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cee7a2e0-6d1b-4441-ba2d-34f79dd94896 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:09.506793 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ca0cddb-3367-4a76-86e4-d3ee547670f6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:09.507304 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ca0cddb-3367-4a76-86e4-d3ee547670f6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:09.517005 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ca0cddb-3367-4a76-86e4-d3ee547670f6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:09.517551 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ca0cddb-3367-4a76-86e4-d3ee547670f6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:09.533323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cee7a2e0-6d1b-4441-ba2d-34f79dd94896 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:09.534089 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cee7a2e0-6d1b-4441-ba2d-34f79dd94896 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:09.538338 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cee7a2e0-6d1b-4441-ba2d-34f79dd94896 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:09.539086 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cee7a2e0-6d1b-4441-ba2d-34f79dd94896 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:10.332327 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6ca0cddb-3367-4a76-86e4-d3ee547670f6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:10.352912 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6ca0cddb-3367-4a76-86e4-d3ee547670f6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1318 microversion: 2.1 time: 0.891054 Apr 14 16:11:10.364192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 16/31] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:09 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1318 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:10.376137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-4c44fad7-796c-49c4-9590-4e982187c0e6 req-a5aaca12-41bb-488a-be64-bdda6906e907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f8c55df-edf8-4724-b17f-3208b924a324", "tag": "8c7ab778-5b23-468f-a76c-4db3dc5b5d0f"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:10.384532 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:10.384532 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:10.408165 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-4c44fad7-796c-49c4-9590-4e982187c0e6 req-a5aaca12-41bb-488a-be64-bdda6906e907 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:10.411919 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-4c44fad7-796c-49c4-9590-4e982187c0e6 req-a5aaca12-41bb-488a-be64-bdda6906e907 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:10.449892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cee7a2e0-6d1b-4441-ba2d-34f79dd94896 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:10.467728 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-4c44fad7-796c-49c4-9590-4e982187c0e6 req-a5aaca12-41bb-488a-be64-bdda6906e907 service nova] Creating event network-changed:8c7ab778-5b23-468f-a76c-4db3dc5b5d0f for instance 1f8c55df-edf8-4724-b17f-3208b924a324 on hv-cinder-78626 Apr 14 16:11:10.485410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cee7a2e0-6d1b-4441-ba2d-34f79dd94896 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:10.487528 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cee7a2e0-6d1b-4441-ba2d-34f79dd94896 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:10.489374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-4c44fad7-796c-49c4-9590-4e982187c0e6 req-a5aaca12-41bb-488a-be64-bdda6906e907 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123370 Apr 14 16:11:10.490785 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cee7a2e0-6d1b-4441-ba2d-34f79dd94896 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1339 microversion: 2.20 time: 1.010000 Apr 14 16:11:10.491680 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:10.505149 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 16/33] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:11:09 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1339 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:11:10.510488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-42172257-8b30-4d30-81be-58ee4898a07b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:10.511926 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-42172257-8b30-4d30-81be-58ee4898a07b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:10.523341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-42172257-8b30-4d30-81be-58ee4898a07b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:10.524427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1160374108", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "adcbfc8b-7eee-4f76-a3ae-c2c3e4974f9c"}]}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:10.525742 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-42172257-8b30-4d30-81be-58ee4898a07b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:10.531636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-42172257-8b30-4d30-81be-58ee4898a07b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:10.532608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-42172257-8b30-4d30-81be-58ee4898a07b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:10.750957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] validate_networks() for [('adcbfc8b-7eee-4f76-a3ae-c2c3e4974f9c', None, None, None)] {{(pid=99334) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:11:11.971654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-42172257-8b30-4d30-81be-58ee4898a07b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:11.992991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-42172257-8b30-4d30-81be-58ee4898a07b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1314 microversion: 2.1 time: 1.479043 Apr 14 16:11:11.994727 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 17/34] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:10 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1314 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:12.005822 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4c85e224-bb27-4298-b85f-8fa92a55eceb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:12.005822 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4c85e224-bb27-4298-b85f-8fa92a55eceb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:12.032567 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4c85e224-bb27-4298-b85f-8fa92a55eceb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:12.034338 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4c85e224-bb27-4298-b85f-8fa92a55eceb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:12.039302 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4c85e224-bb27-4298-b85f-8fa92a55eceb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:12.040066 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4c85e224-bb27-4298-b85f-8fa92a55eceb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:12.803849 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4c85e224-bb27-4298-b85f-8fa92a55eceb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:12.815770 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4c85e224-bb27-4298-b85f-8fa92a55eceb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1318 microversion: 2.1 time: 0.819770 Apr 14 16:11:12.816398 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 18/35] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:11 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:12.823858 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b802fbb5-3896-4084-b3ca-704add18d059 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:12.829792 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b802fbb5-3896-4084-b3ca-704add18d059 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:12.846957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b802fbb5-3896-4084-b3ca-704add18d059 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:12.848126 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b802fbb5-3896-4084-b3ca-704add18d059 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:12.849547 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b802fbb5-3896-4084-b3ca-704add18d059 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:12.850189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b802fbb5-3896-4084-b3ca-704add18d059 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:13.635410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Flavor limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:11:13.635864 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Image limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:11:13.636686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Flavor pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:11:13.637309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Image pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:11:13.637898 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:11:13.653955 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:13.655332 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:13.658128 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:13.659069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:13.709942 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Getting quotas for project 3ef0238a8f524a30a94d06aa25d272f8. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:11:13.717421 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Getting quotas for user 530f5df43ffe47f68faced876280447a and project 3ef0238a8f524a30a94d06aa25d272f8. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:11:13.764249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Going to run 1 instances... {{(pid=99334) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:11:13.786970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:11:13.929092 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0d3bcb56-e6f9-406c-8a44-042a66eaa8df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.422225 Apr 14 16:11:13.930124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 18/36] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:11:10 2021] POST /compute/v2.1/servers => generated 383 bytes in 3424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:11:13.941928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a08ea548-ac18-4398-b178-d7837355e907 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:13.943306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a08ea548-ac18-4398-b178-d7837355e907 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:13.955850 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a08ea548-ac18-4398-b178-d7837355e907 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:13.956650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a08ea548-ac18-4398-b178-d7837355e907 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:13.957845 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a08ea548-ac18-4398-b178-d7837355e907 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:13.958600 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a08ea548-ac18-4398-b178-d7837355e907 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:14.451800 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a08ea548-ac18-4398-b178-d7837355e907 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:14.468259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a08ea548-ac18-4398-b178-d7837355e907 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1314 microversion: 2.1 time: 0.530672 Apr 14 16:11:14.482510 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 19/37] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:13 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:14.509407 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-10bfd289-15bf-40e0-bebe-54c5603626a3 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:14.521096 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-10bfd289-15bf-40e0-bebe-54c5603626a3 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:14.536802 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10bfd289-15bf-40e0-bebe-54c5603626a3 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:14.537335 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10bfd289-15bf-40e0-bebe-54c5603626a3 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:14.538203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10bfd289-15bf-40e0-bebe-54c5603626a3 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:14.538691 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10bfd289-15bf-40e0-bebe-54c5603626a3 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:14.726381 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b802fbb5-3896-4084-b3ca-704add18d059 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:14.754517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b802fbb5-3896-4084-b3ca-704add18d059 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:14.756236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b802fbb5-3896-4084-b3ca-704add18d059 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:14.757537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b802fbb5-3896-4084-b3ca-704add18d059 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1407 microversion: 2.20 time: 1.938669 Apr 14 16:11:14.758339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 19/38] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:11:12 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1407 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:11:14.764306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fdb3f61b-35c4-468d-8182-c699c495ba0a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:14.771949 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fdb3f61b-35c4-468d-8182-c699c495ba0a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:14.870674 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-10bfd289-15bf-40e0-bebe-54c5603626a3 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:14.882228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-10bfd289-15bf-40e0-bebe-54c5603626a3 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1318 microversion: 2.1 time: 0.397793 Apr 14 16:11:14.883137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 20/39] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:14 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:15.249337 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fdb3f61b-35c4-468d-8182-c699c495ba0a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:15.258693 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fdb3f61b-35c4-468d-8182-c699c495ba0a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1222 microversion: 2.1 time: 0.498964 Apr 14 16:11:15.262814 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 20/40] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:14 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1222 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:15.501028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-aae4f88f-6ae5-4c12-a9df-2c098ecf4a3c tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:15.501028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-aae4f88f-6ae5-4c12-a9df-2c098ecf4a3c tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:15.518202 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aae4f88f-6ae5-4c12-a9df-2c098ecf4a3c tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:15.518883 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aae4f88f-6ae5-4c12-a9df-2c098ecf4a3c tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:15.519879 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aae4f88f-6ae5-4c12-a9df-2c098ecf4a3c tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:15.525928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aae4f88f-6ae5-4c12-a9df-2c098ecf4a3c tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:15.614074 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-8f412d27-d151-42cf-8ac5-94a20de8e465 req-0c09ea01-402a-4024-8837-4df6970f7963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e0bacb9-233d-4561-9882-6c9619a84e69", "name": "network-vif-plugged", "status": "completed", "tag": "a6efdcb1-cac1-4a1b-88d3-3d4a36081e9f"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:15.616197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:15.616197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:15.634121 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-8f412d27-d151-42cf-8ac5-94a20de8e465 req-0c09ea01-402a-4024-8837-4df6970f7963 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:15.634627 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-8f412d27-d151-42cf-8ac5-94a20de8e465 req-0c09ea01-402a-4024-8837-4df6970f7963 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:15.655171 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-8f412d27-d151-42cf-8ac5-94a20de8e465 req-0c09ea01-402a-4024-8837-4df6970f7963 service nova] Creating event network-vif-plugged:a6efdcb1-cac1-4a1b-88d3-3d4a36081e9f for instance 3e0bacb9-233d-4561-9882-6c9619a84e69 on hv-cinder-78626 Apr 14 16:11:15.661359 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-8f412d27-d151-42cf-8ac5-94a20de8e465 req-0c09ea01-402a-4024-8837-4df6970f7963 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.328703 Apr 14 16:11:15.662033 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 21/41] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:15.784059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b645d8d6-0f86-4d6b-b996-1a3fcac3b51c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:15.785371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b645d8d6-0f86-4d6b-b996-1a3fcac3b51c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:15.795982 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b645d8d6-0f86-4d6b-b996-1a3fcac3b51c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:15.796760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b645d8d6-0f86-4d6b-b996-1a3fcac3b51c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:15.797582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b645d8d6-0f86-4d6b-b996-1a3fcac3b51c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:15.798672 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b645d8d6-0f86-4d6b-b996-1a3fcac3b51c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:16.052283 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b645d8d6-0f86-4d6b-b996-1a3fcac3b51c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:16.065742 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b645d8d6-0f86-4d6b-b996-1a3fcac3b51c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:16.067617 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b645d8d6-0f86-4d6b-b996-1a3fcac3b51c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:16.069076 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b645d8d6-0f86-4d6b-b996-1a3fcac3b51c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1407 microversion: 2.20 time: 0.291017 Apr 14 16:11:16.069970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:11:15 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:11:16.077124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0bed8a4d-bf65-482e-ae3a-7c81e9fae154 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:16.078433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0bed8a4d-bf65-482e-ae3a-7c81e9fae154 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:16.086938 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0bed8a4d-bf65-482e-ae3a-7c81e9fae154 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:16.087753 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0bed8a4d-bf65-482e-ae3a-7c81e9fae154 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:16.093289 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0bed8a4d-bf65-482e-ae3a-7c81e9fae154 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:16.094194 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0bed8a4d-bf65-482e-ae3a-7c81e9fae154 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:16.253950 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-aae4f88f-6ae5-4c12-a9df-2c098ecf4a3c tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:16.269881 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-aae4f88f-6ae5-4c12-a9df-2c098ecf4a3c tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1314 microversion: 2.1 time: 0.774433 Apr 14 16:11:16.272157 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 21/43] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:15 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1314 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:16.291160 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4966fb20-1ec6-4241-8997-4ceadce324d7 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:16.294066 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4966fb20-1ec6-4241-8997-4ceadce324d7 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:16.318099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4966fb20-1ec6-4241-8997-4ceadce324d7 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:16.320514 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4966fb20-1ec6-4241-8997-4ceadce324d7 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:16.322830 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4966fb20-1ec6-4241-8997-4ceadce324d7 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:16.324288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4966fb20-1ec6-4241-8997-4ceadce324d7 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:16.403448 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0bed8a4d-bf65-482e-ae3a-7c81e9fae154 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:16.413547 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0bed8a4d-bf65-482e-ae3a-7c81e9fae154 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1318 microversion: 2.1 time: 0.342201 Apr 14 16:11:16.414165 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 23/44] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:16 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:16.562867 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4966fb20-1ec6-4241-8997-4ceadce324d7 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:16.574254 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4966fb20-1ec6-4241-8997-4ceadce324d7 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1218 microversion: 2.1 time: 0.292836 Apr 14 16:11:16.575232 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 22/45] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:16 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1218 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:17.066287 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-b1586640-1b17-4171-a130-6e82c395702c req-5158ab7b-8cb3-494f-a8d9-dcaa2271143f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e83f61-2715-436f-8d7c-88c4483cc0e5", "tag": "d74de9c1-8188-4d05-92fc-6cdce0aa2e31"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:17.067920 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:17.067920 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:17.082857 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-b1586640-1b17-4171-a130-6e82c395702c req-5158ab7b-8cb3-494f-a8d9-dcaa2271143f service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:17.083367 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-b1586640-1b17-4171-a130-6e82c395702c req-5158ab7b-8cb3-494f-a8d9-dcaa2271143f service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:17.090351 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-330a7a83-4832-4c26-9696-3b52722ce554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:17.091797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-330a7a83-4832-4c26-9696-3b52722ce554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:17.115070 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-b1586640-1b17-4171-a130-6e82c395702c req-5158ab7b-8cb3-494f-a8d9-dcaa2271143f service nova] Creating event network-changed:d74de9c1-8188-4d05-92fc-6cdce0aa2e31 for instance 97e83f61-2715-436f-8d7c-88c4483cc0e5 on hv-cinder-78626 Apr 14 16:11:17.120952 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-b1586640-1b17-4171-a130-6e82c395702c req-5158ab7b-8cb3-494f-a8d9-dcaa2271143f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058574 Apr 14 16:11:17.122211 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 24/46] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:17.124000 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-330a7a83-4832-4c26-9696-3b52722ce554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:17.127757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-330a7a83-4832-4c26-9696-3b52722ce554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:17.128817 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-330a7a83-4832-4c26-9696-3b52722ce554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:17.130267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-330a7a83-4832-4c26-9696-3b52722ce554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:17.291557 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-94d6172e-32f6-406a-895f-630c9166d166 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:17.294807 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-94d6172e-32f6-406a-895f-630c9166d166 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:17.307911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94d6172e-32f6-406a-895f-630c9166d166 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:17.308598 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94d6172e-32f6-406a-895f-630c9166d166 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:17.309784 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94d6172e-32f6-406a-895f-630c9166d166 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:17.310459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94d6172e-32f6-406a-895f-630c9166d166 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:17.733156 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-330a7a83-4832-4c26-9696-3b52722ce554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:17.756754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-94d6172e-32f6-406a-895f-630c9166d166 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:17.757666 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-330a7a83-4832-4c26-9696-3b52722ce554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:17.761317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-330a7a83-4832-4c26-9696-3b52722ce554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:17.765416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-330a7a83-4832-4c26-9696-3b52722ce554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1407 microversion: 2.20 time: 0.680543 Apr 14 16:11:17.766251 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:11:17 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1407 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:11:17.777310 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8d384a4d-0d86-485b-8dbf-def6308330d5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:17.777310 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8d384a4d-0d86-485b-8dbf-def6308330d5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:17.781860 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8d384a4d-0d86-485b-8dbf-def6308330d5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:17.782993 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8d384a4d-0d86-485b-8dbf-def6308330d5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:17.787597 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-94d6172e-32f6-406a-895f-630c9166d166 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1314 microversion: 2.1 time: 0.500439 Apr 14 16:11:17.788358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 25/48] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:17 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:17.788737 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8d384a4d-0d86-485b-8dbf-def6308330d5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:17.789482 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8d384a4d-0d86-485b-8dbf-def6308330d5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:17.802226 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7f3fa846-9c43-42c4-8629-8abbd73c1013 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:17.802976 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7f3fa846-9c43-42c4-8629-8abbd73c1013 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:17.812688 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7f3fa846-9c43-42c4-8629-8abbd73c1013 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:17.813198 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7f3fa846-9c43-42c4-8629-8abbd73c1013 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:17.814470 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7f3fa846-9c43-42c4-8629-8abbd73c1013 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:17.815100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7f3fa846-9c43-42c4-8629-8abbd73c1013 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:18.057968 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7f3fa846-9c43-42c4-8629-8abbd73c1013 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:18.076748 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7f3fa846-9c43-42c4-8629-8abbd73c1013 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1218 microversion: 2.1 time: 0.283313 Apr 14 16:11:18.078700 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 26/49] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:17 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1218 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:18.093918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-344d91d1-32a3-4ed4-95d2-a8361f584d7c req-332e4c60-344b-4659-852f-a7bda7ba11d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f8c55df-edf8-4724-b17f-3208b924a324", "name": "network-vif-plugged", "status": "completed", "tag": "8c7ab778-5b23-468f-a76c-4db3dc5b5d0f"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:18.097193 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:18.097193 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:18.109134 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-344d91d1-32a3-4ed4-95d2-a8361f584d7c req-332e4c60-344b-4659-852f-a7bda7ba11d7 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:18.110300 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-344d91d1-32a3-4ed4-95d2-a8361f584d7c req-332e4c60-344b-4659-852f-a7bda7ba11d7 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:18.157956 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-344d91d1-32a3-4ed4-95d2-a8361f584d7c req-332e4c60-344b-4659-852f-a7bda7ba11d7 service nova] Creating event network-vif-plugged:8c7ab778-5b23-468f-a76c-4db3dc5b5d0f for instance 1f8c55df-edf8-4724-b17f-3208b924a324 on hv-cinder-78626 Apr 14 16:11:18.164541 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-344d91d1-32a3-4ed4-95d2-a8361f584d7c req-332e4c60-344b-4659-852f-a7bda7ba11d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083675 Apr 14 16:11:18.165541 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 27/50] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:18.177979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-699691273", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5635013d-c232-42e6-92f8-9c466e9855da"}], "security_groups": [{"name": "tempest-securitygroup--656321179"}], "key_name": "tempest-keypair-555153971", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:18.421896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] validate_networks() for [('5635013d-c232-42e6-92f8-9c466e9855da', None, None, None)] {{(pid=99334) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:11:18.947617 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8d384a4d-0d86-485b-8dbf-def6308330d5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:18.963653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8d384a4d-0d86-485b-8dbf-def6308330d5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1318 microversion: 2.1 time: 1.194292 Apr 14 16:11:18.967094 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 24/51] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:17 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1318 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:18.978843 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-858062f8-41ba-4b44-bdc0-5bd0f2cfd953 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:18.979809 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-858062f8-41ba-4b44-bdc0-5bd0f2cfd953 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:18.997503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-858062f8-41ba-4b44-bdc0-5bd0f2cfd953 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:18.998461 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-858062f8-41ba-4b44-bdc0-5bd0f2cfd953 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:18.999549 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-858062f8-41ba-4b44-bdc0-5bd0f2cfd953 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:19.000234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-858062f8-41ba-4b44-bdc0-5bd0f2cfd953 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:19.876549 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-858062f8-41ba-4b44-bdc0-5bd0f2cfd953 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:19.887548 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-858062f8-41ba-4b44-bdc0-5bd0f2cfd953 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:19.890921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-858062f8-41ba-4b44-bdc0-5bd0f2cfd953 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:19.892760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-858062f8-41ba-4b44-bdc0-5bd0f2cfd953 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1407 microversion: 2.20 time: 0.924302 Apr 14 16:11:19.893513 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 25/52] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:11:18 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1407 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:11:19.910877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b9330556-bf95-4dc2-bcaf-57596902937b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:19.911823 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b9330556-bf95-4dc2-bcaf-57596902937b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:19.924306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b9330556-bf95-4dc2-bcaf-57596902937b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:19.925047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b9330556-bf95-4dc2-bcaf-57596902937b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:19.926634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b9330556-bf95-4dc2-bcaf-57596902937b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:19.927612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b9330556-bf95-4dc2-bcaf-57596902937b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:20.470837 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Flavor limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:11:20.471601 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Image limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:11:20.472216 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Flavor pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:11:20.472772 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Image pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:11:20.473403 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:11:20.484314 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:20.484940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:20.485929 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:20.486473 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:20.508052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Getting quotas for project 933c87bdb5354dc39f728c1bc6dfd17e. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:11:20.513891 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Getting quotas for user 041bede4dd8e421c939c6fd868ac654e and project 933c87bdb5354dc39f728c1bc6dfd17e. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:11:20.526243 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Going to run 1 instances... {{(pid=99334) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:11:20.530270 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:11:20.594137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ee8f8095-e853-45af-975e-370ae90b2131 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.426241 Apr 14 16:11:20.594971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 28/53] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:11:18 2021] POST /compute/v2.1/servers => generated 401 bytes in 2429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:11:20.607821 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ab7cbb88-848a-44d6-b30b-922289066098 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:20.611050 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ab7cbb88-848a-44d6-b30b-922289066098 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:20.627412 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ab7cbb88-848a-44d6-b30b-922289066098 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:20.628100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ab7cbb88-848a-44d6-b30b-922289066098 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:20.629479 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ab7cbb88-848a-44d6-b30b-922289066098 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:20.630677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ab7cbb88-848a-44d6-b30b-922289066098 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:21.095913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ab7cbb88-848a-44d6-b30b-922289066098 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:21.139300 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ab7cbb88-848a-44d6-b30b-922289066098 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1280 microversion: 2.1 time: 0.542704 Apr 14 16:11:21.140183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 29/54] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:20 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1280 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:21.146879 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-52852321-d264-448a-81ae-c6c9218b2583 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:21.147904 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-52852321-d264-448a-81ae-c6c9218b2583 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:21.171986 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-52852321-d264-448a-81ae-c6c9218b2583 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:21.172496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-52852321-d264-448a-81ae-c6c9218b2583 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:21.175775 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-52852321-d264-448a-81ae-c6c9218b2583 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:21.176285 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-52852321-d264-448a-81ae-c6c9218b2583 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:21.203933 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b9330556-bf95-4dc2-bcaf-57596902937b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:21.224238 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b9330556-bf95-4dc2-bcaf-57596902937b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1314 microversion: 2.1 time: 1.321886 Apr 14 16:11:21.227447 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 26/55] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:19 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1314 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:21.246545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-41885d4f-8f14-4943-b129-5ff3a69016db tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:21.247899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-41885d4f-8f14-4943-b129-5ff3a69016db tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:21.265599 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-41885d4f-8f14-4943-b129-5ff3a69016db tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:21.266431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-41885d4f-8f14-4943-b129-5ff3a69016db tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:21.267500 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-41885d4f-8f14-4943-b129-5ff3a69016db tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:21.268183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-41885d4f-8f14-4943-b129-5ff3a69016db tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:21.577723 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-41885d4f-8f14-4943-b129-5ff3a69016db tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:21.593262 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-41885d4f-8f14-4943-b129-5ff3a69016db tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1240 microversion: 2.1 time: 0.364358 Apr 14 16:11:21.594131 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 27/56] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:21 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1240 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:21.614872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f4a98b90-083e-4bfc-9318-76942b239682 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:21.615914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f4a98b90-083e-4bfc-9318-76942b239682 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:21.627010 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f4a98b90-083e-4bfc-9318-76942b239682 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:21.627713 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f4a98b90-083e-4bfc-9318-76942b239682 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:21.628750 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f4a98b90-083e-4bfc-9318-76942b239682 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:21.629886 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f4a98b90-083e-4bfc-9318-76942b239682 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:21.679285 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-52852321-d264-448a-81ae-c6c9218b2583 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:21.692449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-52852321-d264-448a-81ae-c6c9218b2583 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1318 microversion: 2.1 time: 0.550824 Apr 14 16:11:21.693133 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 30/57] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:21 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1318 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:22.157831 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3df50e38-09c5-4451-b76c-bdf7ac1f2f36 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:22.159181 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3df50e38-09c5-4451-b76c-bdf7ac1f2f36 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:22.168486 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3df50e38-09c5-4451-b76c-bdf7ac1f2f36 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:22.172199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3df50e38-09c5-4451-b76c-bdf7ac1f2f36 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:22.173895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3df50e38-09c5-4451-b76c-bdf7ac1f2f36 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:22.174603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3df50e38-09c5-4451-b76c-bdf7ac1f2f36 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:22.859450 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f4a98b90-083e-4bfc-9318-76942b239682 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:22.871071 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f4a98b90-083e-4bfc-9318-76942b239682 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:22.874899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f4a98b90-083e-4bfc-9318-76942b239682 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:22.877436 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f4a98b90-083e-4bfc-9318-76942b239682 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1407 microversion: 2.20 time: 1.281131 Apr 14 16:11:22.878763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 28/58] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:11:21 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1407 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:11:22.885802 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-49c170b6-b07a-4362-b516-8146b4832df2 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:22.886726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-49c170b6-b07a-4362-b516-8146b4832df2 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:22.899685 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49c170b6-b07a-4362-b516-8146b4832df2 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:22.901194 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49c170b6-b07a-4362-b516-8146b4832df2 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:22.902487 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49c170b6-b07a-4362-b516-8146b4832df2 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:22.903209 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49c170b6-b07a-4362-b516-8146b4832df2 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:23.005648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3df50e38-09c5-4451-b76c-bdf7ac1f2f36 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:23.015734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3df50e38-09c5-4451-b76c-bdf7ac1f2f36 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1322 microversion: 2.1 time: 0.862613 Apr 14 16:11:23.016514 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 31/59] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:22 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1322 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:11:23.021555 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6f891d4e-23a9-459d-bedb-cafad1011e13 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:23.022445 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6f891d4e-23a9-459d-bedb-cafad1011e13 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:23.032581 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f891d4e-23a9-459d-bedb-cafad1011e13 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:23.033097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f891d4e-23a9-459d-bedb-cafad1011e13 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:23.034150 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f891d4e-23a9-459d-bedb-cafad1011e13 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:23.034650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f891d4e-23a9-459d-bedb-cafad1011e13 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:23.266878 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6f891d4e-23a9-459d-bedb-cafad1011e13 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:23.276489 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6f891d4e-23a9-459d-bedb-cafad1011e13 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1294 microversion: 2.1 time: 0.258673 Apr 14 16:11:23.277179 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 32/60] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:23 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1294 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:23.283607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7f2c61ff-e0bf-44b7-9596-c42cb7123482 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:23.284426 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7f2c61ff-e0bf-44b7-9596-c42cb7123482 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:23.297634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7f2c61ff-e0bf-44b7-9596-c42cb7123482 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:23.298114 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7f2c61ff-e0bf-44b7-9596-c42cb7123482 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:23.299148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7f2c61ff-e0bf-44b7-9596-c42cb7123482 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:23.300307 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7f2c61ff-e0bf-44b7-9596-c42cb7123482 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:23.771410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-49c170b6-b07a-4362-b516-8146b4832df2 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:23.786738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-49c170b6-b07a-4362-b516-8146b4832df2 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1501 microversion: 2.1 time: 0.905741 Apr 14 16:11:23.787728 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 29/61] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:22 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1501 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:23.794473 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-4db5797d-ba79-492d-89d9-13dff71200dd req-9c4906c6-b956-469b-aeb7-1ab7352036ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a704e48-ff08-4961-9c93-7a0fdf04543d", "tag": "56a60b7b-6e5f-46c0-9f81-4dffc4926337"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:23.797248 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:23.797248 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:23.816697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-4db5797d-ba79-492d-89d9-13dff71200dd req-9c4906c6-b956-469b-aeb7-1ab7352036ba service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:23.817441 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-4db5797d-ba79-492d-89d9-13dff71200dd req-9c4906c6-b956-469b-aeb7-1ab7352036ba service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:23.841860 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-4db5797d-ba79-492d-89d9-13dff71200dd req-9c4906c6-b956-469b-aeb7-1ab7352036ba service nova] Creating event network-changed:56a60b7b-6e5f-46c0-9f81-4dffc4926337 for instance 0a704e48-ff08-4961-9c93-7a0fdf04543d on hv-cinder-78626 Apr 14 16:11:23.842526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-4db5797d-ba79-492d-89d9-13dff71200dd req-9c4906c6-b956-469b-aeb7-1ab7352036ba service nova] Acquired lock "compute-rpcapi-router" {{(pid=99335) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 14 16:11:23.845060 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5547ffae-2be5-4d52-9a68-91ee1c9bf372 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:23.846876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5547ffae-2be5-4d52-9a68-91ee1c9bf372 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:23.848372 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5547ffae-2be5-4d52-9a68-91ee1c9bf372 None None] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:23.849526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5547ffae-2be5-4d52-9a68-91ee1c9bf372 None None] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:23.861934 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.compute.rpcapi [None req-5547ffae-2be5-4d52-9a68-91ee1c9bf372 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 14 16:11:23.863143 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5547ffae-2be5-4d52-9a68-91ee1c9bf372 None None] Releasing lock "compute-rpcapi-router" {{(pid=99335) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 14 16:11:23.899817 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5547ffae-2be5-4d52-9a68-91ee1c9bf372 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110485 Apr 14 16:11:23.900651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 30/62] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:23.908045 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-84c563bf-9af0-4c2f-a65b-bdc70a9c5955 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:23.908834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-84c563bf-9af0-4c2f-a65b-bdc70a9c5955 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:23.927307 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84c563bf-9af0-4c2f-a65b-bdc70a9c5955 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:23.927814 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84c563bf-9af0-4c2f-a65b-bdc70a9c5955 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:23.928686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84c563bf-9af0-4c2f-a65b-bdc70a9c5955 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:23.929211 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84c563bf-9af0-4c2f-a65b-bdc70a9c5955 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:24.241939 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7f2c61ff-e0bf-44b7-9596-c42cb7123482 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:24.268601 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7f2c61ff-e0bf-44b7-9596-c42cb7123482 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1508 microversion: 2.1 time: 0.982695 Apr 14 16:11:24.271004 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 33/63] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:23 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1508 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:24.276991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c05385d4-d3a5-4213-807d-7334ec97a08c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:24.278085 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c05385d4-d3a5-4213-807d-7334ec97a08c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:24.302054 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c05385d4-d3a5-4213-807d-7334ec97a08c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:24.302875 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c05385d4-d3a5-4213-807d-7334ec97a08c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:24.304255 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c05385d4-d3a5-4213-807d-7334ec97a08c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:24.308928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c05385d4-d3a5-4213-807d-7334ec97a08c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:24.867431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-84c563bf-9af0-4c2f-a65b-bdc70a9c5955 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:24.882396 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-84c563bf-9af0-4c2f-a65b-bdc70a9c5955 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:24.884115 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-84c563bf-9af0-4c2f-a65b-bdc70a9c5955 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:24.885346 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-84c563bf-9af0-4c2f-a65b-bdc70a9c5955 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1407 microversion: 2.20 time: 0.983627 Apr 14 16:11:24.885975 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 31/64] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:11:23 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1407 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:11:24.898980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-87ec7499-10d5-4286-9705-28992b49e870 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:24.898980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-87ec7499-10d5-4286-9705-28992b49e870 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:24.932043 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-87ec7499-10d5-4286-9705-28992b49e870 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:24.932542 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-87ec7499-10d5-4286-9705-28992b49e870 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:24.942075 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-87ec7499-10d5-4286-9705-28992b49e870 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:24.942603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-87ec7499-10d5-4286-9705-28992b49e870 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:25.030708 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c05385d4-d3a5-4213-807d-7334ec97a08c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:25.043014 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c05385d4-d3a5-4213-807d-7334ec97a08c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1322 microversion: 2.1 time: 0.770516 Apr 14 16:11:25.046694 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 34/65] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:24 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1322 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:25.425679 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-87ec7499-10d5-4286-9705-28992b49e870 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:25.439766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-87ec7499-10d5-4286-9705-28992b49e870 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1294 microversion: 2.1 time: 0.552629 Apr 14 16:11:25.453597 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 32/66] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:24 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1294 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:25.768588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bd83edba-1631-4dfd-bd9b-e20debac7130 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f23a7907-2d85-41a3-8952-e111b38585b7"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:25.769972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bd83edba-1631-4dfd-bd9b-e20debac7130 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:25.786830 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd83edba-1631-4dfd-bd9b-e20debac7130 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:25.787346 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd83edba-1631-4dfd-bd9b-e20debac7130 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:25.788201 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd83edba-1631-4dfd-bd9b-e20debac7130 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:25.790886 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd83edba-1631-4dfd-bd9b-e20debac7130 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:25.996762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-4412d5de-5b37-4a38-869b-2fa79a7c0cdc req-301572f7-18f9-4572-8de7-611691f7aa03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab89b0d-d22c-4d99-8946-878629b4a370", "tag": "d0063e5f-fce6-4c5b-9155-46be8709096a"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:26.010135 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:26.010135 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:26.033486 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-4412d5de-5b37-4a38-869b-2fa79a7c0cdc req-301572f7-18f9-4572-8de7-611691f7aa03 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:26.034296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-4412d5de-5b37-4a38-869b-2fa79a7c0cdc req-301572f7-18f9-4572-8de7-611691f7aa03 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:26.080466 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-4412d5de-5b37-4a38-869b-2fa79a7c0cdc req-301572f7-18f9-4572-8de7-611691f7aa03 service nova] Creating event network-changed:d0063e5f-fce6-4c5b-9155-46be8709096a for instance dab89b0d-d22c-4d99-8946-878629b4a370 on hv-cinder-78626 Apr 14 16:11:26.112959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-4412d5de-5b37-4a38-869b-2fa79a7c0cdc req-301572f7-18f9-4572-8de7-611691f7aa03 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.430404 Apr 14 16:11:26.114219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 35/67] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:26.119731 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2d4a2bfb-21d9-4a2f-8fcc-d48a341017c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:26.125699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2d4a2bfb-21d9-4a2f-8fcc-d48a341017c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:26.144695 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2d4a2bfb-21d9-4a2f-8fcc-d48a341017c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:26.152010 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2d4a2bfb-21d9-4a2f-8fcc-d48a341017c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:26.153614 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2d4a2bfb-21d9-4a2f-8fcc-d48a341017c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:26.154286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2d4a2bfb-21d9-4a2f-8fcc-d48a341017c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:26.850186 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2d4a2bfb-21d9-4a2f-8fcc-d48a341017c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:26.864783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2d4a2bfb-21d9-4a2f-8fcc-d48a341017c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:26.866559 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2d4a2bfb-21d9-4a2f-8fcc-d48a341017c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:26.867974 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2d4a2bfb-21d9-4a2f-8fcc-d48a341017c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1407 microversion: 2.20 time: 0.752402 Apr 14 16:11:26.880870 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 36/68] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:11:26 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1407 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:11:26.886537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f6ac8e0f-d5eb-4bb0-8f88-c3e1bb94e66b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:26.887420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f6ac8e0f-d5eb-4bb0-8f88-c3e1bb94e66b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:26.898391 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f6ac8e0f-d5eb-4bb0-8f88-c3e1bb94e66b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:26.899492 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f6ac8e0f-d5eb-4bb0-8f88-c3e1bb94e66b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:26.901734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f6ac8e0f-d5eb-4bb0-8f88-c3e1bb94e66b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:26.902408 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f6ac8e0f-d5eb-4bb0-8f88-c3e1bb94e66b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:26.949937 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bd83edba-1631-4dfd-bd9b-e20debac7130 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "POST /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.185674 Apr 14 16:11:26.956997 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 33/69] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Apr 14 16:11:25 2021] POST /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324/os-volume_attachments => generated 194 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:11:26.967354 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-54ec46e1-778c-430e-817f-8e85207d4646 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:26.969910 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-54ec46e1-778c-430e-817f-8e85207d4646 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:26.990864 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54ec46e1-778c-430e-817f-8e85207d4646 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:26.992759 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54ec46e1-778c-430e-817f-8e85207d4646 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:26.996489 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54ec46e1-778c-430e-817f-8e85207d4646 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:26.998109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54ec46e1-778c-430e-817f-8e85207d4646 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:27.542806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-54ec46e1-778c-430e-817f-8e85207d4646 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:27.557430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-54ec46e1-778c-430e-817f-8e85207d4646 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1361 microversion: 2.1 time: 0.598231 Apr 14 16:11:27.558090 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 34/70] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:26 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1361 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:27.563677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-af37cee0-2e92-4314-84ac-66b4a86ead33 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ccea1e8-8ae8-4193-a318-28bd0f1bc636"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:27.564963 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-af37cee0-2e92-4314-84ac-66b4a86ead33 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:27.584804 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-af37cee0-2e92-4314-84ac-66b4a86ead33 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:27.585341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-af37cee0-2e92-4314-84ac-66b4a86ead33 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:27.586218 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-af37cee0-2e92-4314-84ac-66b4a86ead33 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:27.586720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-af37cee0-2e92-4314-84ac-66b4a86ead33 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:27.762489 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f6ac8e0f-d5eb-4bb0-8f88-c3e1bb94e66b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:27.782766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f6ac8e0f-d5eb-4bb0-8f88-c3e1bb94e66b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1322 microversion: 2.1 time: 0.892471 Apr 14 16:11:27.783970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 37/71] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:26 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1322 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:27.886706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cbf223dd-3c67-4f07-9632-f710b0166bcd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:27.889133 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cbf223dd-3c67-4f07-9632-f710b0166bcd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:27.903191 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbf223dd-3c67-4f07-9632-f710b0166bcd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:27.905528 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbf223dd-3c67-4f07-9632-f710b0166bcd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:27.908085 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbf223dd-3c67-4f07-9632-f710b0166bcd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:27.909113 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbf223dd-3c67-4f07-9632-f710b0166bcd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:28.525337 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-af37cee0-2e92-4314-84ac-66b4a86ead33 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "POST /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.965482 Apr 14 16:11:28.526028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 35/72] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Apr 14 16:11:27 2021] POST /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69/os-volume_attachments => generated 194 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:28.577797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c0204548-506a-433e-8627-f739939dd9f6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:28.578604 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c0204548-506a-433e-8627-f739939dd9f6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:28.596601 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cbf223dd-3c67-4f07-9632-f710b0166bcd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:28.608916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cbf223dd-3c67-4f07-9632-f710b0166bcd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:28.612927 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0204548-506a-433e-8627-f739939dd9f6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:28.613688 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0204548-506a-433e-8627-f739939dd9f6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:28.614606 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0204548-506a-433e-8627-f739939dd9f6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:28.615113 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0204548-506a-433e-8627-f739939dd9f6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:28.619440 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cbf223dd-3c67-4f07-9632-f710b0166bcd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:28.620661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cbf223dd-3c67-4f07-9632-f710b0166bcd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1407 microversion: 2.20 time: 0.738176 Apr 14 16:11:28.633274 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 38/73] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:11:27 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1407 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:11:28.800898 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-609544e2-2814-486a-8c50-1dcd1c6621e0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:28.801570 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-609544e2-2814-486a-8c50-1dcd1c6621e0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:28.810126 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-609544e2-2814-486a-8c50-1dcd1c6621e0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:28.810644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-609544e2-2814-486a-8c50-1dcd1c6621e0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:28.811481 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-609544e2-2814-486a-8c50-1dcd1c6621e0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:28.811970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-609544e2-2814-486a-8c50-1dcd1c6621e0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:29.093305 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c0204548-506a-433e-8627-f739939dd9f6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:29.125496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c0204548-506a-433e-8627-f739939dd9f6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1361 microversion: 2.1 time: 0.550959 Apr 14 16:11:29.131668 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 36/74] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:28 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1361 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:11:29.138203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-cef50890-6813-4f24-8a65-6b4df5b3885a req-6eae90a7-f59e-43ec-bb6d-4812098cae77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd8ae4b-9ee1-4ba9-830e-d1e721901938", "tag": "77aa0f57-1061-4ceb-8c03-558b3b45583f"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:29.146432 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:29.146432 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:29.171747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-cef50890-6813-4f24-8a65-6b4df5b3885a req-6eae90a7-f59e-43ec-bb6d-4812098cae77 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:29.174120 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-cef50890-6813-4f24-8a65-6b4df5b3885a req-6eae90a7-f59e-43ec-bb6d-4812098cae77 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:29.254817 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-cef50890-6813-4f24-8a65-6b4df5b3885a req-6eae90a7-f59e-43ec-bb6d-4812098cae77 service nova] Creating event network-changed:77aa0f57-1061-4ceb-8c03-558b3b45583f for instance 0dd8ae4b-9ee1-4ba9-830e-d1e721901938 on hv-cinder-78626 Apr 14 16:11:29.276362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-cef50890-6813-4f24-8a65-6b4df5b3885a req-6eae90a7-f59e-43ec-bb6d-4812098cae77 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142536 Apr 14 16:11:29.277192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 37/75] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:29.295782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-88ee44d5-d5b1-4d71-94fd-f853958e398f req-a47d03de-647a-4b9f-b995-66bb6b351945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e83f61-2715-436f-8d7c-88c4483cc0e5", "name": "network-vif-plugged", "status": "completed", "tag": "d74de9c1-8188-4d05-92fc-6cdce0aa2e31"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:29.308930 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:29.308930 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:29.332652 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-88ee44d5-d5b1-4d71-94fd-f853958e398f req-a47d03de-647a-4b9f-b995-66bb6b351945 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:29.334021 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-88ee44d5-d5b1-4d71-94fd-f853958e398f req-a47d03de-647a-4b9f-b995-66bb6b351945 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:29.342341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-609544e2-2814-486a-8c50-1dcd1c6621e0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:29.357207 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-609544e2-2814-486a-8c50-1dcd1c6621e0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1322 microversion: 2.1 time: 0.559936 Apr 14 16:11:29.358022 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 39/76] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:28 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1322 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:29.360702 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-88ee44d5-d5b1-4d71-94fd-f853958e398f req-a47d03de-647a-4b9f-b995-66bb6b351945 service nova] Creating event network-vif-plugged:d74de9c1-8188-4d05-92fc-6cdce0aa2e31 for instance 97e83f61-2715-436f-8d7c-88c4483cc0e5 on hv-cinder-78626 Apr 14 16:11:29.372022 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-88ee44d5-d5b1-4d71-94fd-f853958e398f req-a47d03de-647a-4b9f-b995-66bb6b351945 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093106 Apr 14 16:11:29.372709 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 38/77] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:29.648374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6ba9220d-7c69-4c8d-afeb-870b5558c0b5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:29.649260 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6ba9220d-7c69-4c8d-afeb-870b5558c0b5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:29.665626 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ba9220d-7c69-4c8d-afeb-870b5558c0b5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:29.666478 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ba9220d-7c69-4c8d-afeb-870b5558c0b5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:29.667512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ba9220d-7c69-4c8d-afeb-870b5558c0b5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:29.668184 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ba9220d-7c69-4c8d-afeb-870b5558c0b5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:30.064317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6ba9220d-7c69-4c8d-afeb-870b5558c0b5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:30.077822 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6ba9220d-7c69-4c8d-afeb-870b5558c0b5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:30.079517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6ba9220d-7c69-4c8d-afeb-870b5558c0b5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:30.080697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6ba9220d-7c69-4c8d-afeb-870b5558c0b5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1407 microversion: 2.20 time: 0.437258 Apr 14 16:11:30.091936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 40/78] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:11:29 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1407 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:11:30.150351 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7b2f25bb-8d1f-4f7e-abd9-3d7832591127 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:30.151778 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7b2f25bb-8d1f-4f7e-abd9-3d7832591127 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:30.169262 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7b2f25bb-8d1f-4f7e-abd9-3d7832591127 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:30.173399 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7b2f25bb-8d1f-4f7e-abd9-3d7832591127 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:30.175027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7b2f25bb-8d1f-4f7e-abd9-3d7832591127 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:30.175854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7b2f25bb-8d1f-4f7e-abd9-3d7832591127 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:30.377665 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-acaa7464-37e4-4d6e-bdba-e92795feabcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:30.378548 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-acaa7464-37e4-4d6e-bdba-e92795feabcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:30.388716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-acaa7464-37e4-4d6e-bdba-e92795feabcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:30.389820 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-acaa7464-37e4-4d6e-bdba-e92795feabcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:30.391047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-acaa7464-37e4-4d6e-bdba-e92795feabcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:30.392021 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-acaa7464-37e4-4d6e-bdba-e92795feabcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:30.643937 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-acaa7464-37e4-4d6e-bdba-e92795feabcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:30.654447 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-acaa7464-37e4-4d6e-bdba-e92795feabcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1322 microversion: 2.1 time: 0.282530 Apr 14 16:11:30.655530 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 41/79] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:30 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:30.702335 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7b2f25bb-8d1f-4f7e-abd9-3d7832591127 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:30.721116 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7b2f25bb-8d1f-4f7e-abd9-3d7832591127 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1361 microversion: 2.1 time: 0.573592 Apr 14 16:11:30.722421 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 39/80] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:30 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1361 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:31.099947 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4e350327-ed0c-49e3-90c6-443c7ac6fbbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:31.100613 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4e350327-ed0c-49e3-90c6-443c7ac6fbbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:31.112882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4e350327-ed0c-49e3-90c6-443c7ac6fbbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:31.113422 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4e350327-ed0c-49e3-90c6-443c7ac6fbbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:31.114261 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4e350327-ed0c-49e3-90c6-443c7ac6fbbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:31.116630 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4e350327-ed0c-49e3-90c6-443c7ac6fbbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:31.414291 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4e350327-ed0c-49e3-90c6-443c7ac6fbbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:31.425090 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4e350327-ed0c-49e3-90c6-443c7ac6fbbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:31.426845 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4e350327-ed0c-49e3-90c6-443c7ac6fbbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:31.428107 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4e350327-ed0c-49e3-90c6-443c7ac6fbbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1407 microversion: 2.20 time: 0.332248 Apr 14 16:11:31.428803 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 42/81] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:11:31 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:11:31.674042 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6ed658f9-26a5-4e6f-8f5d-1745defba997 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:31.674861 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6ed658f9-26a5-4e6f-8f5d-1745defba997 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:31.685027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ed658f9-26a5-4e6f-8f5d-1745defba997 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:31.686004 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ed658f9-26a5-4e6f-8f5d-1745defba997 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:31.697828 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ed658f9-26a5-4e6f-8f5d-1745defba997 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:31.698652 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ed658f9-26a5-4e6f-8f5d-1745defba997 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:31.740289 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-40bb8c25-e275-453b-b078-2842024f2d51 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:31.741216 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-40bb8c25-e275-453b-b078-2842024f2d51 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:31.753077 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40bb8c25-e275-453b-b078-2842024f2d51 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:31.753801 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40bb8c25-e275-453b-b078-2842024f2d51 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:31.756706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40bb8c25-e275-453b-b078-2842024f2d51 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:31.757203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40bb8c25-e275-453b-b078-2842024f2d51 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:31.920674 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6ed658f9-26a5-4e6f-8f5d-1745defba997 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:31.929567 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6ed658f9-26a5-4e6f-8f5d-1745defba997 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1322 microversion: 2.1 time: 0.260978 Apr 14 16:11:31.930198 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 40/82] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:31 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:31.969637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-40bb8c25-e275-453b-b078-2842024f2d51 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:31.978433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-40bb8c25-e275-453b-b078-2842024f2d51 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1361 microversion: 2.1 time: 0.242476 Apr 14 16:11:31.979099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 43/83] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:31 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1361 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:11:32.432288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-0f0c19c8-0ed5-4189-857a-dbd0a1ece49a req-2a5de572-7dd2-49cb-95df-6da29b4f88fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a704e48-ff08-4961-9c93-7a0fdf04543d", "name": "network-vif-plugged", "status": "completed", "tag": "56a60b7b-6e5f-46c0-9f81-4dffc4926337"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:32.434266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:32.434266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:32.447789 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cbd37195-8e77-4c87-89b4-63b9b5326e3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:32.448460 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cbd37195-8e77-4c87-89b4-63b9b5326e3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:32.454038 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-0f0c19c8-0ed5-4189-857a-dbd0a1ece49a req-2a5de572-7dd2-49cb-95df-6da29b4f88fa service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:32.458089 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-0f0c19c8-0ed5-4189-857a-dbd0a1ece49a req-2a5de572-7dd2-49cb-95df-6da29b4f88fa service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:32.463446 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbd37195-8e77-4c87-89b4-63b9b5326e3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:32.463957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbd37195-8e77-4c87-89b4-63b9b5326e3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:32.464818 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbd37195-8e77-4c87-89b4-63b9b5326e3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:32.465362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbd37195-8e77-4c87-89b4-63b9b5326e3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:32.489218 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-0f0c19c8-0ed5-4189-857a-dbd0a1ece49a req-2a5de572-7dd2-49cb-95df-6da29b4f88fa service nova] Creating event network-vif-plugged:56a60b7b-6e5f-46c0-9f81-4dffc4926337 for instance 0a704e48-ff08-4961-9c93-7a0fdf04543d on hv-cinder-78626 Apr 14 16:11:32.502181 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-0f0c19c8-0ed5-4189-857a-dbd0a1ece49a req-2a5de572-7dd2-49cb-95df-6da29b4f88fa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074476 Apr 14 16:11:32.503221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 41/84] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:32.770030 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cbd37195-8e77-4c87-89b4-63b9b5326e3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:32.781914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cbd37195-8e77-4c87-89b4-63b9b5326e3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:32.784121 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cbd37195-8e77-4c87-89b4-63b9b5326e3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:32.785348 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cbd37195-8e77-4c87-89b4-63b9b5326e3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1599 microversion: 2.20 time: 0.341813 Apr 14 16:11:32.786133 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 44/85] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:11:32 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1599 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:11:32.805961 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-24f5ede1-0599-45c8-bad8-c4c06a6a7cd3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:32.806610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-24f5ede1-0599-45c8-bad8-c4c06a6a7cd3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:32.815222 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-24f5ede1-0599-45c8-bad8-c4c06a6a7cd3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:32.815735 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-24f5ede1-0599-45c8-bad8-c4c06a6a7cd3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:32.816583 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-24f5ede1-0599-45c8-bad8-c4c06a6a7cd3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:32.817107 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-24f5ede1-0599-45c8-bad8-c4c06a6a7cd3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:32.949157 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-74c1de17-1e32-4c47-b790-7daf2786a23e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:32.950914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-74c1de17-1e32-4c47-b790-7daf2786a23e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:32.961266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-74c1de17-1e32-4c47-b790-7daf2786a23e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:32.962002 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-74c1de17-1e32-4c47-b790-7daf2786a23e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:32.963282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-74c1de17-1e32-4c47-b790-7daf2786a23e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:32.964346 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-74c1de17-1e32-4c47-b790-7daf2786a23e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:32.986999 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-24f5ede1-0599-45c8-bad8-c4c06a6a7cd3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.185730 Apr 14 16:11:32.987783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 42/86] 10.222.0.60 () {60 vars in 1306 bytes} [Wed Apr 14 16:11:32 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:11:33.001231 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-75b8f5cd-0d41-42d1-ba50-4e4ec7fd0ee2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:33.002143 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-75b8f5cd-0d41-42d1-ba50-4e4ec7fd0ee2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:33.014872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-75b8f5cd-0d41-42d1-ba50-4e4ec7fd0ee2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:33.015627 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-75b8f5cd-0d41-42d1-ba50-4e4ec7fd0ee2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:33.016684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-75b8f5cd-0d41-42d1-ba50-4e4ec7fd0ee2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:33.017416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-75b8f5cd-0d41-42d1-ba50-4e4ec7fd0ee2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:33.269264 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-75b8f5cd-0d41-42d1-ba50-4e4ec7fd0ee2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:33.280179 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-75b8f5cd-0d41-42d1-ba50-4e4ec7fd0ee2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1361 microversion: 2.1 time: 0.282970 Apr 14 16:11:33.281081 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 43/87] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:32 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1361 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:33.702235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-74c1de17-1e32-4c47-b790-7daf2786a23e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:33.711292 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-74c1de17-1e32-4c47-b790-7daf2786a23e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1322 microversion: 2.1 time: 0.767206 Apr 14 16:11:33.711877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 45/88] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:32 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1322 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:11:34.298572 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-73578599-f47e-46d1-8cd2-e31ca9400470 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:34.299636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-73578599-f47e-46d1-8cd2-e31ca9400470 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:34.339553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-73578599-f47e-46d1-8cd2-e31ca9400470 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:34.340383 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-73578599-f47e-46d1-8cd2-e31ca9400470 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:34.342001 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-73578599-f47e-46d1-8cd2-e31ca9400470 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:34.344926 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-73578599-f47e-46d1-8cd2-e31ca9400470 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:34.730450 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5ac75b84-af74-4dcb-a7a9-2984e5cb0195 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:34.731691 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5ac75b84-af74-4dcb-a7a9-2984e5cb0195 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:34.740439 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5ac75b84-af74-4dcb-a7a9-2984e5cb0195 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:34.741227 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5ac75b84-af74-4dcb-a7a9-2984e5cb0195 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:34.742273 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5ac75b84-af74-4dcb-a7a9-2984e5cb0195 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:34.742966 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5ac75b84-af74-4dcb-a7a9-2984e5cb0195 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:34.916925 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-73578599-f47e-46d1-8cd2-e31ca9400470 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:34.930747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-73578599-f47e-46d1-8cd2-e31ca9400470 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1361 microversion: 2.1 time: 0.635971 Apr 14 16:11:34.937196 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 44/89] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:34 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1361 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:35.145371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-49ebc216-1e6d-4ca2-a40f-36341c17eb4e req-65574aaa-d1f5-42a1-8505-d7efdee75761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab89b0d-d22c-4d99-8946-878629b4a370", "name": "network-vif-plugged", "status": "completed", "tag": "d0063e5f-fce6-4c5b-9155-46be8709096a"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:35.146878 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:35.146878 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:35.167428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-49ebc216-1e6d-4ca2-a40f-36341c17eb4e req-65574aaa-d1f5-42a1-8505-d7efdee75761 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:35.167939 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-49ebc216-1e6d-4ca2-a40f-36341c17eb4e req-65574aaa-d1f5-42a1-8505-d7efdee75761 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:35.217115 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-49ebc216-1e6d-4ca2-a40f-36341c17eb4e req-65574aaa-d1f5-42a1-8505-d7efdee75761 service nova] Creating event network-vif-plugged:d0063e5f-fce6-4c5b-9155-46be8709096a for instance dab89b0d-d22c-4d99-8946-878629b4a370 on hv-cinder-78626 Apr 14 16:11:35.233537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-49ebc216-1e6d-4ca2-a40f-36341c17eb4e req-65574aaa-d1f5-42a1-8505-d7efdee75761 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089594 Apr 14 16:11:35.234541 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 45/90] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:35.635190 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5ac75b84-af74-4dcb-a7a9-2984e5cb0195 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:35.659667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5ac75b84-af74-4dcb-a7a9-2984e5cb0195 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1322 microversion: 2.1 time: 0.934196 Apr 14 16:11:35.675762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 46/91] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:34 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1322 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:35.721862 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8dd88972-1ecd-4a47-aa37-118273b23f69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:35.723132 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8dd88972-1ecd-4a47-aa37-118273b23f69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:35.730887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-77dd8545-68eb-4adc-95d1-27668a743b6f req-5c809836-aa63-44bb-8cec-3173ddbfb1ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e83f61-2715-436f-8d7c-88c4483cc0e5", "tag": "d74de9c1-8188-4d05-92fc-6cdce0aa2e31"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:35.733866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:35.733866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:35.745738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8dd88972-1ecd-4a47-aa37-118273b23f69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:35.746647 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8dd88972-1ecd-4a47-aa37-118273b23f69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:35.751607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-77dd8545-68eb-4adc-95d1-27668a743b6f req-5c809836-aa63-44bb-8cec-3173ddbfb1ef service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:35.752497 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8dd88972-1ecd-4a47-aa37-118273b23f69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:35.752899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-77dd8545-68eb-4adc-95d1-27668a743b6f req-5c809836-aa63-44bb-8cec-3173ddbfb1ef service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:35.753082 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8dd88972-1ecd-4a47-aa37-118273b23f69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:35.777095 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-77dd8545-68eb-4adc-95d1-27668a743b6f req-5c809836-aa63-44bb-8cec-3173ddbfb1ef service nova] Creating event network-changed:d74de9c1-8188-4d05-92fc-6cdce0aa2e31 for instance 97e83f61-2715-436f-8d7c-88c4483cc0e5 on hv-cinder-78626 Apr 14 16:11:35.784459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-77dd8545-68eb-4adc-95d1-27668a743b6f req-5c809836-aa63-44bb-8cec-3173ddbfb1ef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057655 Apr 14 16:11:35.785471 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 47/92] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:11:35.958201 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fff4497e-8c75-43ac-969d-bad2cc00a63f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:35.959610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fff4497e-8c75-43ac-969d-bad2cc00a63f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:35.992848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fff4497e-8c75-43ac-969d-bad2cc00a63f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:35.996292 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fff4497e-8c75-43ac-969d-bad2cc00a63f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:36.003121 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fff4497e-8c75-43ac-969d-bad2cc00a63f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:36.005468 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fff4497e-8c75-43ac-969d-bad2cc00a63f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:36.042400 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8dd88972-1ecd-4a47-aa37-118273b23f69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.324679 Apr 14 16:11:36.042400 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 46/93] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:35 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:36.666472 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fff4497e-8c75-43ac-969d-bad2cc00a63f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:36.678511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a633a682-2afb-4dd3-8fac-af436ab536ad tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:36.679381 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a633a682-2afb-4dd3-8fac-af436ab536ad tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:36.699117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fff4497e-8c75-43ac-969d-bad2cc00a63f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1361 microversion: 2.1 time: 0.747332 Apr 14 16:11:36.702808 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a633a682-2afb-4dd3-8fac-af436ab536ad tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:36.703310 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a633a682-2afb-4dd3-8fac-af436ab536ad tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:36.704164 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a633a682-2afb-4dd3-8fac-af436ab536ad tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:36.704653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a633a682-2afb-4dd3-8fac-af436ab536ad tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:36.705412 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 48/94] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:35 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1361 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:11:36.875424 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8df4e3d1-908f-464e-a7bd-6b5723a0637d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:36.876511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8df4e3d1-908f-464e-a7bd-6b5723a0637d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:36.885869 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8df4e3d1-908f-464e-a7bd-6b5723a0637d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:36.886577 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8df4e3d1-908f-464e-a7bd-6b5723a0637d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:36.888202 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8df4e3d1-908f-464e-a7bd-6b5723a0637d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:36.889002 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8df4e3d1-908f-464e-a7bd-6b5723a0637d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:36.974258 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8df4e3d1-908f-464e-a7bd-6b5723a0637d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Going to try to terminate instance {{(pid=99334) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:11:37.007738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a633a682-2afb-4dd3-8fac-af436ab536ad tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:37.018691 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a633a682-2afb-4dd3-8fac-af436ab536ad tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1322 microversion: 2.1 time: 0.344961 Apr 14 16:11:37.019632 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 47/95] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:36 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:11:37.055796 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0a0f1dec-c2bb-4e4e-a600-e163a8ca18e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:37.056998 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0a0f1dec-c2bb-4e4e-a600-e163a8ca18e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:37.066691 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0a0f1dec-c2bb-4e4e-a600-e163a8ca18e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:37.067540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0a0f1dec-c2bb-4e4e-a600-e163a8ca18e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:37.068568 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0a0f1dec-c2bb-4e4e-a600-e163a8ca18e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:37.069272 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0a0f1dec-c2bb-4e4e-a600-e163a8ca18e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:37.242785 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8df4e3d1-908f-464e-a7bd-6b5723a0637d tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 204 len: 0 microversion: 2.1 time: 0.369597 Apr 14 16:11:37.246486 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 49/96] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:11:36 2021] DELETE /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:11:37.261834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6b1d59bc-f6db-4a98-b073-f438b62b909b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:37.263057 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6b1d59bc-f6db-4a98-b073-f438b62b909b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:37.271443 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b1d59bc-f6db-4a98-b073-f438b62b909b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:37.272309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b1d59bc-f6db-4a98-b073-f438b62b909b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:37.273668 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b1d59bc-f6db-4a98-b073-f438b62b909b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:37.273946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b1d59bc-f6db-4a98-b073-f438b62b909b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:37.344453 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0a0f1dec-c2bb-4e4e-a600-e163a8ca18e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.292581 Apr 14 16:11:37.345529 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 48/97] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:37 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:11:37.719659 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d86d5c8a-018f-4316-9ccb-477618c61635 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:37.720518 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d86d5c8a-018f-4316-9ccb-477618c61635 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:37.736069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d86d5c8a-018f-4316-9ccb-477618c61635 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:37.737979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d86d5c8a-018f-4316-9ccb-477618c61635 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:37.740739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d86d5c8a-018f-4316-9ccb-477618c61635 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:37.741410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d86d5c8a-018f-4316-9ccb-477618c61635 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:37.822438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6b1d59bc-f6db-4a98-b073-f438b62b909b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:37.838723 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6b1d59bc-f6db-4a98-b073-f438b62b909b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1553 microversion: 2.1 time: 0.581742 Apr 14 16:11:37.849854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 50/98] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:37 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1553 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:38.042083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a4b80182-c5b7-4a83-9292-4a7f4520a0a8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:38.043357 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a4b80182-c5b7-4a83-9292-4a7f4520a0a8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:38.068250 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4b80182-c5b7-4a83-9292-4a7f4520a0a8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:38.068766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4b80182-c5b7-4a83-9292-4a7f4520a0a8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:38.069656 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4b80182-c5b7-4a83-9292-4a7f4520a0a8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:38.070143 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4b80182-c5b7-4a83-9292-4a7f4520a0a8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:38.125534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d86d5c8a-018f-4316-9ccb-477618c61635 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:38.136685 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d86d5c8a-018f-4316-9ccb-477618c61635 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1361 microversion: 2.1 time: 0.422335 Apr 14 16:11:38.149293 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 49/99] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:37 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1361 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:38.357196 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f1791858-d2e1-4b6a-a32b-9ed85030e779 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:38.358791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f1791858-d2e1-4b6a-a32b-9ed85030e779 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:38.374135 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1791858-d2e1-4b6a-a32b-9ed85030e779 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:38.385384 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1791858-d2e1-4b6a-a32b-9ed85030e779 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:38.386503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1791858-d2e1-4b6a-a32b-9ed85030e779 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:38.390966 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1791858-d2e1-4b6a-a32b-9ed85030e779 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:38.617402 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f1791858-d2e1-4b6a-a32b-9ed85030e779 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.264747 Apr 14 16:11:38.618881 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 50/100] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:38 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:11:38.682344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a4b80182-c5b7-4a83-9292-4a7f4520a0a8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:38.695049 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a4b80182-c5b7-4a83-9292-4a7f4520a0a8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1515 microversion: 2.1 time: 0.656852 Apr 14 16:11:38.695937 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 51/101] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:38 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1515 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:38.716138 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-489a600c-f494-4220-9932-99420711c12f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:38.722460 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-489a600c-f494-4220-9932-99420711c12f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:38.743225 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-489a600c-f494-4220-9932-99420711c12f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:38.743841 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-489a600c-f494-4220-9932-99420711c12f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:38.744937 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-489a600c-f494-4220-9932-99420711c12f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:38.745657 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-489a600c-f494-4220-9932-99420711c12f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:38.792096 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-e276ddf8-800b-4a93-a6e4-bea5f91491d2 req-ccfb8626-454d-4d6a-9c56-cc88e55a12a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd8ae4b-9ee1-4ba9-830e-d1e721901938", "name": "network-vif-plugged", "status": "completed", "tag": "77aa0f57-1061-4ceb-8c03-558b3b45583f"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:38.794158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:38.794158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:38.814086 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-e276ddf8-800b-4a93-a6e4-bea5f91491d2 req-ccfb8626-454d-4d6a-9c56-cc88e55a12a7 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:38.814579 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-e276ddf8-800b-4a93-a6e4-bea5f91491d2 req-ccfb8626-454d-4d6a-9c56-cc88e55a12a7 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:38.834077 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-489a600c-f494-4220-9932-99420711c12f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lazy-loading 'flavor' on Instance uuid dab89b0d-d22c-4d99-8946-878629b4a370 {{(pid=99335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:11:38.857934 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-e276ddf8-800b-4a93-a6e4-bea5f91491d2 req-ccfb8626-454d-4d6a-9c56-cc88e55a12a7 service nova] Creating event network-vif-plugged:77aa0f57-1061-4ceb-8c03-558b3b45583f for instance 0dd8ae4b-9ee1-4ba9-830e-d1e721901938 on hv-cinder-78626 Apr 14 16:11:38.876339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-e276ddf8-800b-4a93-a6e4-bea5f91491d2 req-ccfb8626-454d-4d6a-9c56-cc88e55a12a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090650 Apr 14 16:11:38.876953 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 52/102] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:11:38.891990 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a2755e2e-60b9-4829-9367-b3c9daa34c75 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:38.892799 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a2755e2e-60b9-4829-9367-b3c9daa34c75 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:38.933996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2755e2e-60b9-4829-9367-b3c9daa34c75 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:38.935574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2755e2e-60b9-4829-9367-b3c9daa34c75 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:38.937342 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2755e2e-60b9-4829-9367-b3c9daa34c75 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:38.937911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2755e2e-60b9-4829-9367-b3c9daa34c75 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:39.039784 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-489a600c-f494-4220-9932-99420711c12f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "POST /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370/action" status: 200 len: 32 microversion: 2.1 time: 0.328317 Apr 14 16:11:39.041296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 51/103] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:11:38 2021] POST /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370/action => generated 32 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:11:39.052314 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-23b154be-8f1f-4f40-9ddf-2adc9d4af726 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:39.054415 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-23b154be-8f1f-4f40-9ddf-2adc9d4af726 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:39.072660 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23b154be-8f1f-4f40-9ddf-2adc9d4af726 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:39.073491 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23b154be-8f1f-4f40-9ddf-2adc9d4af726 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:39.074918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23b154be-8f1f-4f40-9ddf-2adc9d4af726 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:39.077119 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23b154be-8f1f-4f40-9ddf-2adc9d4af726 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:39.452386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a2755e2e-60b9-4829-9367-b3c9daa34c75 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:39.466397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a2755e2e-60b9-4829-9367-b3c9daa34c75 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1553 microversion: 2.1 time: 0.584306 Apr 14 16:11:39.487187 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 53/104] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:38 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1553 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:39.502613 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6094c5fc-a415-4ea5-a50e-97d91973f018 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:39.503589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6094c5fc-a415-4ea5-a50e-97d91973f018 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:39.521437 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6094c5fc-a415-4ea5-a50e-97d91973f018 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:39.522780 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6094c5fc-a415-4ea5-a50e-97d91973f018 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:39.524067 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6094c5fc-a415-4ea5-a50e-97d91973f018 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:39.524758 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6094c5fc-a415-4ea5-a50e-97d91973f018 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:39.769282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-23b154be-8f1f-4f40-9ddf-2adc9d4af726 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:39.782924 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-23b154be-8f1f-4f40-9ddf-2adc9d4af726 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.735158 Apr 14 16:11:39.784046 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 52/105] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:39 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:39.789203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c6eb141d-c5d4-438e-afa4-f10fd3200caf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:39.790462 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c6eb141d-c5d4-438e-afa4-f10fd3200caf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:39.799015 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c6eb141d-c5d4-438e-afa4-f10fd3200caf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:39.800156 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c6eb141d-c5d4-438e-afa4-f10fd3200caf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:39.801300 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c6eb141d-c5d4-438e-afa4-f10fd3200caf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:39.801983 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c6eb141d-c5d4-438e-afa4-f10fd3200caf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:39.954190 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c6eb141d-c5d4-438e-afa4-f10fd3200caf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.168414 Apr 14 16:11:39.954888 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 53/106] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:39 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:40.242981 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6094c5fc-a415-4ea5-a50e-97d91973f018 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:40.254003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6094c5fc-a415-4ea5-a50e-97d91973f018 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1361 microversion: 2.1 time: 0.765380 Apr 14 16:11:40.254871 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 54/107] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:39 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1361 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:40.489150 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4da39416-1f54-4e27-80fb-0153ba0d5dba tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:40.489922 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4da39416-1f54-4e27-80fb-0153ba0d5dba tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:40.499612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4da39416-1f54-4e27-80fb-0153ba0d5dba tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:40.500307 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4da39416-1f54-4e27-80fb-0153ba0d5dba tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:40.501137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4da39416-1f54-4e27-80fb-0153ba0d5dba tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:40.501628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4da39416-1f54-4e27-80fb-0153ba0d5dba tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:40.723414 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4da39416-1f54-4e27-80fb-0153ba0d5dba tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:40.742187 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4da39416-1f54-4e27-80fb-0153ba0d5dba tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1553 microversion: 2.1 time: 0.257379 Apr 14 16:11:40.743024 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 54/108] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:40 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1553 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:40.801828 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-06c1cd0e-e741-4496-8890-894df799b43a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:40.803080 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-06c1cd0e-e741-4496-8890-894df799b43a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:40.813769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06c1cd0e-e741-4496-8890-894df799b43a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:40.813769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06c1cd0e-e741-4496-8890-894df799b43a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:40.813769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06c1cd0e-e741-4496-8890-894df799b43a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:40.813769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06c1cd0e-e741-4496-8890-894df799b43a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:40.965898 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e9770cc6-97cd-4289-964d-4673e896a903 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:40.967047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e9770cc6-97cd-4289-964d-4673e896a903 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:40.975111 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e9770cc6-97cd-4289-964d-4673e896a903 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:40.975824 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e9770cc6-97cd-4289-964d-4673e896a903 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:40.976695 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e9770cc6-97cd-4289-964d-4673e896a903 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:40.977357 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e9770cc6-97cd-4289-964d-4673e896a903 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:41.082593 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-06c1cd0e-e741-4496-8890-894df799b43a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:41.092586 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-06c1cd0e-e741-4496-8890-894df799b43a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.294838 Apr 14 16:11:41.102959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 55/109] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:40 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:41.147634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e9770cc6-97cd-4289-964d-4673e896a903 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.185381 Apr 14 16:11:41.148431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 55/110] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:40 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:41.273061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2b825413-ef9f-40de-ad36-4251cecfdb81 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:41.273828 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2b825413-ef9f-40de-ad36-4251cecfdb81 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:41.295340 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2b825413-ef9f-40de-ad36-4251cecfdb81 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:41.296414 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2b825413-ef9f-40de-ad36-4251cecfdb81 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:41.302258 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2b825413-ef9f-40de-ad36-4251cecfdb81 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:41.303129 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2b825413-ef9f-40de-ad36-4251cecfdb81 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:41.615288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2b825413-ef9f-40de-ad36-4251cecfdb81 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:41.634545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2b825413-ef9f-40de-ad36-4251cecfdb81 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1547 microversion: 2.1 time: 0.366345 Apr 14 16:11:41.635540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 56/111] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:41 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1547 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:41.655239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-13f905ae-8e92-4c5d-8926-08aebb7755be tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:41.655986 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-13f905ae-8e92-4c5d-8926-08aebb7755be tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:41.674735 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-13f905ae-8e92-4c5d-8926-08aebb7755be tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:41.675350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-13f905ae-8e92-4c5d-8926-08aebb7755be tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:41.677316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-13f905ae-8e92-4c5d-8926-08aebb7755be tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:41.678812 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-13f905ae-8e92-4c5d-8926-08aebb7755be tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:41.761030 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ad6c4556-be05-49eb-bcc6-f17d7e260c5b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:41.761713 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ad6c4556-be05-49eb-bcc6-f17d7e260c5b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:41.774052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ad6c4556-be05-49eb-bcc6-f17d7e260c5b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:41.774569 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ad6c4556-be05-49eb-bcc6-f17d7e260c5b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:41.775418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ad6c4556-be05-49eb-bcc6-f17d7e260c5b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:41.775904 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ad6c4556-be05-49eb-bcc6-f17d7e260c5b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:42.007242 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ad6c4556-be05-49eb-bcc6-f17d7e260c5b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:42.018431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ad6c4556-be05-49eb-bcc6-f17d7e260c5b tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1553 microversion: 2.1 time: 0.260698 Apr 14 16:11:42.018431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 57/112] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:41 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1553 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:42.112168 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b639bdbf-71aa-4ac9-9bee-01ca79e5a69e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:42.116650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b639bdbf-71aa-4ac9-9bee-01ca79e5a69e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:42.155934 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b639bdbf-71aa-4ac9-9bee-01ca79e5a69e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:42.156446 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b639bdbf-71aa-4ac9-9bee-01ca79e5a69e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:42.157587 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b639bdbf-71aa-4ac9-9bee-01ca79e5a69e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:42.158074 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b639bdbf-71aa-4ac9-9bee-01ca79e5a69e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:42.395050 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b639bdbf-71aa-4ac9-9bee-01ca79e5a69e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:42.405067 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b639bdbf-71aa-4ac9-9bee-01ca79e5a69e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.296852 Apr 14 16:11:42.405716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 58/113] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:42 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:42.411827 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-feb569a8-d45c-40d6-9517-2953a297bca7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:42.412968 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-feb569a8-d45c-40d6-9517-2953a297bca7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:42.420863 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-feb569a8-d45c-40d6-9517-2953a297bca7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:42.421745 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-feb569a8-d45c-40d6-9517-2953a297bca7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:42.422729 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-feb569a8-d45c-40d6-9517-2953a297bca7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:42.423194 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-feb569a8-d45c-40d6-9517-2953a297bca7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:42.477566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-13f905ae-8e92-4c5d-8926-08aebb7755be tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.828057 Apr 14 16:11:42.478427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 56/114] 10.222.0.60 () {58 vars in 1265 bytes} [Wed Apr 14 16:11:41 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/os-interface => generated 284 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:42.606006 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-feb569a8-d45c-40d6-9517-2953a297bca7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.197956 Apr 14 16:11:42.607757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 59/115] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:42 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:43.038401 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7ea06090-dcc1-4382-b68d-9a8bf2ac8552 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:43.039129 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7ea06090-dcc1-4382-b68d-9a8bf2ac8552 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:43.041924 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-85e94ed8-b950-4d2a-8b17-d952b15f3fcf req-a4e224bc-d653-45d7-8ee8-9039a6fa9ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f8c55df-edf8-4724-b17f-3208b924a324", "name": "network-vif-deleted", "tag": "8c7ab778-5b23-468f-a76c-4db3dc5b5d0f"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:43.045090 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:43.045090 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:43.062389 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7ea06090-dcc1-4382-b68d-9a8bf2ac8552 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:43.064277 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7ea06090-dcc1-4382-b68d-9a8bf2ac8552 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:43.065564 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7ea06090-dcc1-4382-b68d-9a8bf2ac8552 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:43.068309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7ea06090-dcc1-4382-b68d-9a8bf2ac8552 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:43.090422 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-85e94ed8-b950-4d2a-8b17-d952b15f3fcf req-a4e224bc-d653-45d7-8ee8-9039a6fa9ea0 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:43.091932 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-85e94ed8-b950-4d2a-8b17-d952b15f3fcf req-a4e224bc-d653-45d7-8ee8-9039a6fa9ea0 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:43.124903 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-85e94ed8-b950-4d2a-8b17-d952b15f3fcf req-a4e224bc-d653-45d7-8ee8-9039a6fa9ea0 service nova] Creating event network-vif-deleted:8c7ab778-5b23-468f-a76c-4db3dc5b5d0f for instance 1f8c55df-edf8-4724-b17f-3208b924a324 on hv-cinder-78626 Apr 14 16:11:43.135792 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-85e94ed8-b950-4d2a-8b17-d952b15f3fcf req-a4e224bc-d653-45d7-8ee8-9039a6fa9ea0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099114 Apr 14 16:11:43.136631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 60/116] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:43.287951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7ea06090-dcc1-4382-b68d-9a8bf2ac8552 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:43.299180 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7ea06090-dcc1-4382-b68d-9a8bf2ac8552 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1345 microversion: 2.1 time: 0.266850 Apr 14 16:11:43.302907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 57/117] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:43 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1345 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:43.424809 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-37c8791a-8109-4d45-9d69-6baba22fb686 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:43.425897 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-37c8791a-8109-4d45-9d69-6baba22fb686 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:43.434290 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-37c8791a-8109-4d45-9d69-6baba22fb686 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:43.435173 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-37c8791a-8109-4d45-9d69-6baba22fb686 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:43.436355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-37c8791a-8109-4d45-9d69-6baba22fb686 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:43.437068 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-37c8791a-8109-4d45-9d69-6baba22fb686 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:43.619054 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-128c966c-6396-4d02-bea2-df3a73f6df71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:43.620478 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-128c966c-6396-4d02-bea2-df3a73f6df71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:43.628862 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-128c966c-6396-4d02-bea2-df3a73f6df71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:43.629712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-128c966c-6396-4d02-bea2-df3a73f6df71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:43.630794 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-128c966c-6396-4d02-bea2-df3a73f6df71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:43.631515 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-128c966c-6396-4d02-bea2-df3a73f6df71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:43.790227 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-128c966c-6396-4d02-bea2-df3a73f6df71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.174964 Apr 14 16:11:43.791081 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 58/118] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:43 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:11:44.124309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-37c8791a-8109-4d45-9d69-6baba22fb686 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:44.135724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-37c8791a-8109-4d45-9d69-6baba22fb686 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.711977 Apr 14 16:11:44.149426 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 61/119] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:43 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:44.320082 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cdcb7f5e-260e-40f8-b7cf-395e54f48734 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:44.321339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cdcb7f5e-260e-40f8-b7cf-395e54f48734 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:44.344987 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cdcb7f5e-260e-40f8-b7cf-395e54f48734 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:44.346210 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cdcb7f5e-260e-40f8-b7cf-395e54f48734 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:44.358765 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cdcb7f5e-260e-40f8-b7cf-395e54f48734 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:44.359504 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cdcb7f5e-260e-40f8-b7cf-395e54f48734 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:44.529459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cdcb7f5e-260e-40f8-b7cf-395e54f48734 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:44.530061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cdcb7f5e-260e-40f8-b7cf-395e54f48734 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:44.530478 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-cdcb7f5e-260e-40f8-b7cf-395e54f48734 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lazy-loading 'fault' on Instance uuid 1f8c55df-edf8-4724-b17f-3208b924a324 {{(pid=99335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:11:44.552740 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-305773406", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452", "networks": [{"uuid": "2513cfaf-5700-4daa-9c93-a6579fd80809"}]}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:44.657537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cdcb7f5e-260e-40f8-b7cf-395e54f48734 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dc00fb264645ee9968186a4aa9a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2d21c1e64e48cf923ecf68d5af1695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:44.658470 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] validate_networks() for [('2513cfaf-5700-4daa-9c93-a6579fd80809', None, None, None)] {{(pid=99334) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:11:44.668372 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cdcb7f5e-260e-40f8-b7cf-395e54f48734 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 200 len: 1350 microversion: 2.1 time: 0.353350 Apr 14 16:11:44.669311 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 59/120] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:44 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 1350 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:44.805929 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1cb3ed32-2fcf-43e6-974a-cba84405011a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:44.807356 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1cb3ed32-2fcf-43e6-974a-cba84405011a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:44.818834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1cb3ed32-2fcf-43e6-974a-cba84405011a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:44.819591 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1cb3ed32-2fcf-43e6-974a-cba84405011a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:44.820958 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1cb3ed32-2fcf-43e6-974a-cba84405011a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:44.821712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1cb3ed32-2fcf-43e6-974a-cba84405011a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:45.040094 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1cb3ed32-2fcf-43e6-974a-cba84405011a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.241018 Apr 14 16:11:45.040999 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 60/121] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:44 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:45.048441 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-052a3912-6ba7-4923-a14b-8449f7260251 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:45.053452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-052a3912-6ba7-4923-a14b-8449f7260251 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:45.067240 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-052a3912-6ba7-4923-a14b-8449f7260251 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:45.072545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-052a3912-6ba7-4923-a14b-8449f7260251 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:45.073580 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-052a3912-6ba7-4923-a14b-8449f7260251 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:45.074102 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-052a3912-6ba7-4923-a14b-8449f7260251 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:45.241605 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-052a3912-6ba7-4923-a14b-8449f7260251 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 14 microversion: 2.1 time: 0.199145 Apr 14 16:11:45.246230 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 61/122] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:11:45 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:11:45.253308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-235c3c82-2638-4fa1-a795-0fb5c1e7e3be req-7c3c50af-4b81-4a79-a0cd-9e4bb9c952b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd8ae4b-9ee1-4ba9-830e-d1e721901938", "tag": "77aa0f57-1061-4ceb-8c03-558b3b45583f"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:45.257267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:45.257267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:45.274447 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-235c3c82-2638-4fa1-a795-0fb5c1e7e3be req-7c3c50af-4b81-4a79-a0cd-9e4bb9c952b3 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:45.275276 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-235c3c82-2638-4fa1-a795-0fb5c1e7e3be req-7c3c50af-4b81-4a79-a0cd-9e4bb9c952b3 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:45.298719 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-235c3c82-2638-4fa1-a795-0fb5c1e7e3be req-7c3c50af-4b81-4a79-a0cd-9e4bb9c952b3 service nova] Creating event network-changed:77aa0f57-1061-4ceb-8c03-558b3b45583f for instance 0dd8ae4b-9ee1-4ba9-830e-d1e721901938 on hv-cinder-78626 Apr 14 16:11:45.306249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-235c3c82-2638-4fa1-a795-0fb5c1e7e3be req-7c3c50af-4b81-4a79-a0cd-9e4bb9c952b3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057257 Apr 14 16:11:45.307328 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 62/123] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:45.314709 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-119913f3-a45f-454c-ab90-845b1956a03d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:45.316165 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-119913f3-a45f-454c-ab90-845b1956a03d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:45.339464 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-119913f3-a45f-454c-ab90-845b1956a03d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:45.340012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-119913f3-a45f-454c-ab90-845b1956a03d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:45.342988 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-119913f3-a45f-454c-ab90-845b1956a03d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:45.343542 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-119913f3-a45f-454c-ab90-845b1956a03d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:45.580538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Flavor limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:11:45.581219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Image limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:11:45.581762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Flavor pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:11:45.582221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Image pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:11:45.582680 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:11:45.593238 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:45.593744 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:45.594606 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:45.595093 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:45.614551 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Getting quotas for project b8a4298bacf14cd493bcec2e3543ab00. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:11:45.621978 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Getting quotas for user 8a19cff22a01451e8d454b8a8f4cde89 and project b8a4298bacf14cd493bcec2e3543ab00. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:11:45.634040 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Going to run 1 instances... {{(pid=99334) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:11:45.637092 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:11:45.655650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-119913f3-a45f-454c-ab90-845b1956a03d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:45.672179 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-119913f3-a45f-454c-ab90-845b1956a03d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.363346 Apr 14 16:11:45.683498 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 63/124] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:45 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:45.686330 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b07acb55-69b9-46ad-8ae7-bcac46eaee05 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:45.687002 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b07acb55-69b9-46ad-8ae7-bcac46eaee05 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:45.699025 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b07acb55-69b9-46ad-8ae7-bcac46eaee05 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:45.699535 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b07acb55-69b9-46ad-8ae7-bcac46eaee05 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:45.700936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b07acb55-69b9-46ad-8ae7-bcac46eaee05 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:45.701606 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b07acb55-69b9-46ad-8ae7-bcac46eaee05 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:45.742424 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cfcd306f-d3b1-4518-a17a-411a53ee3a9c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.194410 Apr 14 16:11:45.743132 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 62/125] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:11:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:11:45.754008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b17c2eb3-5590-4365-87a0-b64bdbfdf1e5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:45.754668 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b17c2eb3-5590-4365-87a0-b64bdbfdf1e5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:45.850761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-b07acb55-69b9-46ad-8ae7-bcac46eaee05 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] HTTP exception thrown: Instance 1f8c55df-edf8-4724-b17f-3208b924a324 could not be found. Apr 14 16:11:45.852118 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b07acb55-69b9-46ad-8ae7-bcac46eaee05 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Returning 404 to user: Instance 1f8c55df-edf8-4724-b17f-3208b924a324 could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:11:45.853397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b07acb55-69b9-46ad-8ae7-bcac46eaee05 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 404 len: 111 microversion: 2.1 time: 0.171077 Apr 14 16:11:45.863086 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 64/126] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:45 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 16:11:45.968388 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b17c2eb3-5590-4365-87a0-b64bdbfdf1e5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:45.980050 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b17c2eb3-5590-4365-87a0-b64bdbfdf1e5 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1217 microversion: 2.1 time: 0.229482 Apr 14 16:11:45.988872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 63/127] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:45 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1217 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:46.051724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5b5d62f7-68b9-438d-be42-de25389e29a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:46.052761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5b5d62f7-68b9-438d-be42-de25389e29a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:46.068783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5b5d62f7-68b9-438d-be42-de25389e29a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:46.070195 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5b5d62f7-68b9-438d-be42-de25389e29a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:46.070671 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5b5d62f7-68b9-438d-be42-de25389e29a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:46.071186 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5b5d62f7-68b9-438d-be42-de25389e29a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:46.254926 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7be672fa-0593-49b8-a535-05199044814d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:46.256077 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7be672fa-0593-49b8-a535-05199044814d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:46.276536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7be672fa-0593-49b8-a535-05199044814d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:46.277065 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7be672fa-0593-49b8-a535-05199044814d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:46.277934 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7be672fa-0593-49b8-a535-05199044814d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:46.278959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7be672fa-0593-49b8-a535-05199044814d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:46.308195 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5b5d62f7-68b9-438d-be42-de25389e29a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.260196 Apr 14 16:11:46.313259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 65/128] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:46 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:46.499106 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7be672fa-0593-49b8-a535-05199044814d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 14 microversion: 2.1 time: 0.248243 Apr 14 16:11:46.500380 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 64/129] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:11:46 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 14 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 14 16:11:46.703498 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5c719ab4-1149-459a-8c81-54a1955bfa68 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:46.712669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5c719ab4-1149-459a-8c81-54a1955bfa68 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:46.736687 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5c719ab4-1149-459a-8c81-54a1955bfa68 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:46.737536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5c719ab4-1149-459a-8c81-54a1955bfa68 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:46.738543 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5c719ab4-1149-459a-8c81-54a1955bfa68 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:46.739397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5c719ab4-1149-459a-8c81-54a1955bfa68 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:46.982066 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5c719ab4-1149-459a-8c81-54a1955bfa68 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:46.992361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5c719ab4-1149-459a-8c81-54a1955bfa68 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.301977 Apr 14 16:11:46.997734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 66/130] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:46 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:47.000637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8f84ff9b-24ce-4fb3-b51c-f3d2fb498562 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:47.001604 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8f84ff9b-24ce-4fb3-b51c-f3d2fb498562 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:47.010760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f84ff9b-24ce-4fb3-b51c-f3d2fb498562 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:47.011354 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f84ff9b-24ce-4fb3-b51c-f3d2fb498562 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:47.012218 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f84ff9b-24ce-4fb3-b51c-f3d2fb498562 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:47.013301 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f84ff9b-24ce-4fb3-b51c-f3d2fb498562 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:47.182367 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8f84ff9b-24ce-4fb3-b51c-f3d2fb498562 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:47.193283 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8f84ff9b-24ce-4fb3-b51c-f3d2fb498562 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1269 microversion: 2.1 time: 0.198170 Apr 14 16:11:47.194053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 65/131] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:46 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1269 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:47.320392 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-97431f7b-0a10-45c2-9fc0-f7530d268113 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:47.322107 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-97431f7b-0a10-45c2-9fc0-f7530d268113 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:47.330887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-97431f7b-0a10-45c2-9fc0-f7530d268113 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:47.331784 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-97431f7b-0a10-45c2-9fc0-f7530d268113 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:47.332854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-97431f7b-0a10-45c2-9fc0-f7530d268113 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:47.333570 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-97431f7b-0a10-45c2-9fc0-f7530d268113 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:47.510743 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-97431f7b-0a10-45c2-9fc0-f7530d268113 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.194029 Apr 14 16:11:47.511473 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 67/132] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:47 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:47.520408 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-178c8834-60da-4050-972f-2e916fb58af3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:47.529827 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-178c8834-60da-4050-972f-2e916fb58af3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:47.545777 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-178c8834-60da-4050-972f-2e916fb58af3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:47.554279 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-178c8834-60da-4050-972f-2e916fb58af3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:47.562209 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-178c8834-60da-4050-972f-2e916fb58af3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:47.569654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-178c8834-60da-4050-972f-2e916fb58af3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:47.872918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-178c8834-60da-4050-972f-2e916fb58af3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 14 microversion: 2.1 time: 0.365647 Apr 14 16:11:47.873664 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 66/133] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:11:47 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 14 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:11:47.979848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ff0d47a3-c603-4553-8a0f-7b2797f23d90 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:47.980753 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ff0d47a3-c603-4553-8a0f-7b2797f23d90 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:48.002623 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ff0d47a3-c603-4553-8a0f-7b2797f23d90 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:48.004712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ff0d47a3-c603-4553-8a0f-7b2797f23d90 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:48.006240 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ff0d47a3-c603-4553-8a0f-7b2797f23d90 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:48.006932 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ff0d47a3-c603-4553-8a0f-7b2797f23d90 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:48.020895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0cd0e310-9108-4ad7-b836-0738b40735e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:48.021834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0cd0e310-9108-4ad7-b836-0738b40735e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:48.045834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0cd0e310-9108-4ad7-b836-0738b40735e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:48.046569 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0cd0e310-9108-4ad7-b836-0738b40735e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:48.049993 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0cd0e310-9108-4ad7-b836-0738b40735e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:48.050512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0cd0e310-9108-4ad7-b836-0738b40735e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:48.098885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-ff0d47a3-c603-4553-8a0f-7b2797f23d90 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] HTTP exception thrown: Instance 1f8c55df-edf8-4724-b17f-3208b924a324 could not be found. Apr 14 16:11:48.099809 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ff0d47a3-c603-4553-8a0f-7b2797f23d90 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Returning 404 to user: Instance 1f8c55df-edf8-4724-b17f-3208b924a324 could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:11:48.100913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ff0d47a3-c603-4553-8a0f-7b2797f23d90 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 404 len: 111 microversion: 2.1 time: 0.125596 Apr 14 16:11:48.105878 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 68/134] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:11:47 2021] DELETE /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:11:48.121226 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3c9331ab-0ab7-4bc7-8548-df7e78d5afa8 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:48.124912 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3c9331ab-0ab7-4bc7-8548-df7e78d5afa8 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] [instance: 1f8c55df-edf8-4724-b17f-3208b924a324] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:48.149293 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c9331ab-0ab7-4bc7-8548-df7e78d5afa8 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:48.149877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c9331ab-0ab7-4bc7-8548-df7e78d5afa8 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:48.150829 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c9331ab-0ab7-4bc7-8548-df7e78d5afa8 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:48.151371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c9331ab-0ab7-4bc7-8548-df7e78d5afa8 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:48.243217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-3c9331ab-0ab7-4bc7-8548-df7e78d5afa8 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] HTTP exception thrown: Instance 1f8c55df-edf8-4724-b17f-3208b924a324 could not be found. Apr 14 16:11:48.244184 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3c9331ab-0ab7-4bc7-8548-df7e78d5afa8 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] Returning 404 to user: Instance 1f8c55df-edf8-4724-b17f-3208b924a324 could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:11:48.245315 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3c9331ab-0ab7-4bc7-8548-df7e78d5afa8 tempest-DeleteServersTestJSON-1788113849 tempest-DeleteServersTestJSON-1788113849-project] 10.222.0.60 "GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324" status: 404 len: 111 microversion: 2.1 time: 0.133604 Apr 14 16:11:48.246099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 69/135] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:48 2021] GET /compute/v2.1/servers/1f8c55df-edf8-4724-b17f-3208b924a324 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:11:48.251634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ca671dde-94ad-4e93-9898-f9867adc6994 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:48.252538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ca671dde-94ad-4e93-9898-f9867adc6994 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:48.261088 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ca671dde-94ad-4e93-9898-f9867adc6994 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:48.261900 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ca671dde-94ad-4e93-9898-f9867adc6994 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:48.263217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ca671dde-94ad-4e93-9898-f9867adc6994 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:48.264073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ca671dde-94ad-4e93-9898-f9867adc6994 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:48.421967 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ca671dde-94ad-4e93-9898-f9867adc6994 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:48.431241 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ca671dde-94ad-4e93-9898-f9867adc6994 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1275 microversion: 2.1 time: 0.183266 Apr 14 16:11:48.432045 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 70/136] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:48 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1275 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:48.523985 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a1a5501d-9b08-44a8-90f0-8722957ab09f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:48.525309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a1a5501d-9b08-44a8-90f0-8722957ab09f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:48.534300 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a1a5501d-9b08-44a8-90f0-8722957ab09f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:48.535037 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a1a5501d-9b08-44a8-90f0-8722957ab09f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:48.535849 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a1a5501d-9b08-44a8-90f0-8722957ab09f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:48.537101 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a1a5501d-9b08-44a8-90f0-8722957ab09f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:48.671878 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a1a5501d-9b08-44a8-90f0-8722957ab09f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.152052 Apr 14 16:11:48.677331 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 71/137] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:48 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:48.886613 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ba1527a0-981d-475a-8593-165459b7172d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:48.887992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ba1527a0-981d-475a-8593-165459b7172d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:48.897266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ba1527a0-981d-475a-8593-165459b7172d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:48.897888 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ba1527a0-981d-475a-8593-165459b7172d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:48.898810 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ba1527a0-981d-475a-8593-165459b7172d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:48.899641 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ba1527a0-981d-475a-8593-165459b7172d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:49.045499 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ba1527a0-981d-475a-8593-165459b7172d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 14 microversion: 2.1 time: 0.163416 Apr 14 16:11:49.046427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 72/138] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:11:48 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:11:49.050320 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0cd0e310-9108-4ad7-b836-0738b40735e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:49.061923 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0cd0e310-9108-4ad7-b836-0738b40735e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 1.046612 Apr 14 16:11:49.070911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 67/139] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:48 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:49.453227 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-075dd48b-2007-46fe-aad7-2f0e001f2e1e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:49.454335 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-075dd48b-2007-46fe-aad7-2f0e001f2e1e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:49.463905 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-075dd48b-2007-46fe-aad7-2f0e001f2e1e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:49.464709 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-075dd48b-2007-46fe-aad7-2f0e001f2e1e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:49.466538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-075dd48b-2007-46fe-aad7-2f0e001f2e1e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:49.467145 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-075dd48b-2007-46fe-aad7-2f0e001f2e1e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:49.693216 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-66e8ac1c-36e4-4d1e-b90d-9d7f46aa8819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:49.694315 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-66e8ac1c-36e4-4d1e-b90d-9d7f46aa8819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:49.704459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-66e8ac1c-36e4-4d1e-b90d-9d7f46aa8819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:49.705312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-66e8ac1c-36e4-4d1e-b90d-9d7f46aa8819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:49.706370 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-66e8ac1c-36e4-4d1e-b90d-9d7f46aa8819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:49.707013 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-66e8ac1c-36e4-4d1e-b90d-9d7f46aa8819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:49.844230 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-66e8ac1c-36e4-4d1e-b90d-9d7f46aa8819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.164353 Apr 14 16:11:49.845288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 68/140] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:49 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:50.057831 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c82cb380-97f9-4677-90f9-1f6df009133c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:50.060512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c82cb380-97f9-4677-90f9-1f6df009133c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:50.070959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c82cb380-97f9-4677-90f9-1f6df009133c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:50.071722 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c82cb380-97f9-4677-90f9-1f6df009133c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:50.072861 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c82cb380-97f9-4677-90f9-1f6df009133c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:50.073631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c82cb380-97f9-4677-90f9-1f6df009133c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:50.161952 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-075dd48b-2007-46fe-aad7-2f0e001f2e1e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:50.186434 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-075dd48b-2007-46fe-aad7-2f0e001f2e1e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1317 microversion: 2.1 time: 0.739260 Apr 14 16:11:50.187078 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 73/141] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:49 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1317 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:50.213841 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-90c5fafb-839b-4271-9a2e-c887a89dc9fd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:50.214661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-90c5fafb-839b-4271-9a2e-c887a89dc9fd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:50.224701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-90c5fafb-839b-4271-9a2e-c887a89dc9fd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:50.225609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-90c5fafb-839b-4271-9a2e-c887a89dc9fd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:50.227117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-90c5fafb-839b-4271-9a2e-c887a89dc9fd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:50.227809 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-90c5fafb-839b-4271-9a2e-c887a89dc9fd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:50.297980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c82cb380-97f9-4677-90f9-1f6df009133c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 14 microversion: 2.1 time: 0.244525 Apr 14 16:11:50.298844 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 69/142] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:11:50 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 14 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:11:50.830536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-90c5fafb-839b-4271-9a2e-c887a89dc9fd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:50.849430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-90c5fafb-839b-4271-9a2e-c887a89dc9fd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.658395 Apr 14 16:11:50.870781 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-328566a8-bdcc-4000-a76a-2707082501f8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:50.871992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-328566a8-bdcc-4000-a76a-2707082501f8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:50.872913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 74/143] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:50 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:50.882569 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-328566a8-bdcc-4000-a76a-2707082501f8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:50.883408 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-328566a8-bdcc-4000-a76a-2707082501f8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:50.884545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-328566a8-bdcc-4000-a76a-2707082501f8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:50.886152 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-328566a8-bdcc-4000-a76a-2707082501f8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:51.055674 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-328566a8-bdcc-4000-a76a-2707082501f8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.193138 Apr 14 16:11:51.056716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 70/144] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:50 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:51.204295 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b27bcda8-a5e2-4c92-8bb4-50f42961762f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:51.204961 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b27bcda8-a5e2-4c92-8bb4-50f42961762f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:51.212694 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b27bcda8-a5e2-4c92-8bb4-50f42961762f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:51.213490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b27bcda8-a5e2-4c92-8bb4-50f42961762f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:51.214520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b27bcda8-a5e2-4c92-8bb4-50f42961762f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:51.215187 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b27bcda8-a5e2-4c92-8bb4-50f42961762f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:51.316143 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-278f2834-27f2-478d-93e5-72dbd352afc0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:51.317497 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-278f2834-27f2-478d-93e5-72dbd352afc0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:51.328650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-278f2834-27f2-478d-93e5-72dbd352afc0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:51.329465 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-278f2834-27f2-478d-93e5-72dbd352afc0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:51.331059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-278f2834-27f2-478d-93e5-72dbd352afc0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:51.331881 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-278f2834-27f2-478d-93e5-72dbd352afc0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:51.498459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-278f2834-27f2-478d-93e5-72dbd352afc0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 14 microversion: 2.1 time: 0.189389 Apr 14 16:11:51.499383 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 71/145] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:11:51 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:11:51.773098 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b27bcda8-a5e2-4c92-8bb4-50f42961762f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:51.783461 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b27bcda8-a5e2-4c92-8bb4-50f42961762f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1317 microversion: 2.1 time: 0.583417 Apr 14 16:11:51.784282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 75/146] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:51 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1317 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:51.868761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-464faade-c55a-4d64-a844-44bf7a6f9127 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:51.869418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-464faade-c55a-4d64-a844-44bf7a6f9127 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:51.886049 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-464faade-c55a-4d64-a844-44bf7a6f9127 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:51.886603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-464faade-c55a-4d64-a844-44bf7a6f9127 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:51.890329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-464faade-c55a-4d64-a844-44bf7a6f9127 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:51.890685 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-464faade-c55a-4d64-a844-44bf7a6f9127 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:52.068067 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9509db7f-5d7b-42bb-becd-581de2eb3b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:52.069577 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9509db7f-5d7b-42bb-becd-581de2eb3b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:52.086212 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9509db7f-5d7b-42bb-becd-581de2eb3b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:52.086729 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9509db7f-5d7b-42bb-becd-581de2eb3b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:52.087605 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9509db7f-5d7b-42bb-becd-581de2eb3b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:52.088103 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9509db7f-5d7b-42bb-becd-581de2eb3b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:52.329899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9509db7f-5d7b-42bb-becd-581de2eb3b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.266005 Apr 14 16:11:52.330589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 76/147] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:52 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:52.401898 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-464faade-c55a-4d64-a844-44bf7a6f9127 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:52.412853 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-464faade-c55a-4d64-a844-44bf7a6f9127 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.548547 Apr 14 16:11:52.413414 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 72/148] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:51 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:52.510889 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5a186942-a15d-4af9-9345-81f6c097b2f9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:52.512041 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5a186942-a15d-4af9-9345-81f6c097b2f9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:52.524318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a186942-a15d-4af9-9345-81f6c097b2f9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:52.524833 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a186942-a15d-4af9-9345-81f6c097b2f9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:52.525722 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a186942-a15d-4af9-9345-81f6c097b2f9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:52.526203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a186942-a15d-4af9-9345-81f6c097b2f9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:52.688247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5a186942-a15d-4af9-9345-81f6c097b2f9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 14 microversion: 2.1 time: 0.181583 Apr 14 16:11:52.689436 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 77/149] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:11:52 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:11:52.811645 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fb33aca7-343c-470a-99c7-f647efe31ae4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:52.812310 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fb33aca7-343c-470a-99c7-f647efe31ae4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:52.838088 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb33aca7-343c-470a-99c7-f647efe31ae4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:52.838595 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb33aca7-343c-470a-99c7-f647efe31ae4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:52.839470 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb33aca7-343c-470a-99c7-f647efe31ae4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:52.841292 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb33aca7-343c-470a-99c7-f647efe31ae4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:52.892060 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-0cc98b53-8c3e-44cf-85ff-158356fe27e6 req-28a81c81-8ec3-478d-9e14-defb0e5439ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce4fd86-3ba7-4f6b-8962-e1adecda486d", "tag": "6e058dba-7fbb-4a6f-9393-4264eeea9e1a"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:52.894836 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:11:52.894836 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:11:52.914365 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-0cc98b53-8c3e-44cf-85ff-158356fe27e6 req-28a81c81-8ec3-478d-9e14-defb0e5439ef service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:52.915145 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-0cc98b53-8c3e-44cf-85ff-158356fe27e6 req-28a81c81-8ec3-478d-9e14-defb0e5439ef service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:52.939836 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-0cc98b53-8c3e-44cf-85ff-158356fe27e6 req-28a81c81-8ec3-478d-9e14-defb0e5439ef service nova] Creating event network-changed:6e058dba-7fbb-4a6f-9393-4264eeea9e1a for instance bce4fd86-3ba7-4f6b-8962-e1adecda486d on hv-cinder-78626 Apr 14 16:11:52.945206 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-0cc98b53-8c3e-44cf-85ff-158356fe27e6 req-28a81c81-8ec3-478d-9e14-defb0e5439ef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059197 Apr 14 16:11:52.946059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 78/150] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:11:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:53.159019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fb33aca7-343c-470a-99c7-f647efe31ae4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:53.168235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fb33aca7-343c-470a-99c7-f647efe31ae4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1317 microversion: 2.1 time: 0.361039 Apr 14 16:11:53.169479 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 73/151] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:52 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:53.342644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a4a1d521-e6df-4838-b07f-1345f5f4184c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:53.344158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a4a1d521-e6df-4838-b07f-1345f5f4184c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:53.352774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4a1d521-e6df-4838-b07f-1345f5f4184c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:53.353821 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4a1d521-e6df-4838-b07f-1345f5f4184c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:53.354970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4a1d521-e6df-4838-b07f-1345f5f4184c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:53.355728 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4a1d521-e6df-4838-b07f-1345f5f4184c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:53.501710 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a4a1d521-e6df-4838-b07f-1345f5f4184c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.162972 Apr 14 16:11:53.502947 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 79/152] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:53 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:53.509433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-dff534d7-3a26-40f3-ab4c-5df3e1656716 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:53.510452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-dff534d7-3a26-40f3-ab4c-5df3e1656716 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:53.519652 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dff534d7-3a26-40f3-ab4c-5df3e1656716 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:53.520366 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dff534d7-3a26-40f3-ab4c-5df3e1656716 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:53.521642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dff534d7-3a26-40f3-ab4c-5df3e1656716 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:53.522980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dff534d7-3a26-40f3-ab4c-5df3e1656716 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:53.590117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-00a9bd13-5610-49ff-9528-163e55774a00 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Action: 'create', calling method: .version_select at 0x7ff591fe5ea0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-529956353"}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:53.823215 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-dff534d7-3a26-40f3-ab4c-5df3e1656716 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:53.834650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-dff534d7-3a26-40f3-ab4c-5df3e1656716 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.329828 Apr 14 16:11:53.836003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 80/153] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:53 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:53.843643 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8c058047-42b6-4b4f-bb74-49d2674d9cff tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:53.845204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8c058047-42b6-4b4f-bb74-49d2674d9cff tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:53.853611 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8c058047-42b6-4b4f-bb74-49d2674d9cff tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:53.854378 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8c058047-42b6-4b4f-bb74-49d2674d9cff tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:53.855418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8c058047-42b6-4b4f-bb74-49d2674d9cff tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:53.856549 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8c058047-42b6-4b4f-bb74-49d2674d9cff tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:54.003062 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8c058047-42b6-4b4f-bb74-49d2674d9cff tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 14 microversion: 2.1 time: 0.164809 Apr 14 16:11:54.004254 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 81/154] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:11:53 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:11:54.187429 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fdf0088f-65c8-44b1-bb80-d38f1a5b65ec tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:54.188376 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fdf0088f-65c8-44b1-bb80-d38f1a5b65ec tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:54.209206 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fdf0088f-65c8-44b1-bb80-d38f1a5b65ec tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:54.210017 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fdf0088f-65c8-44b1-bb80-d38f1a5b65ec tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:54.217609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fdf0088f-65c8-44b1-bb80-d38f1a5b65ec tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:54.217609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fdf0088f-65c8-44b1-bb80-d38f1a5b65ec tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:54.254575 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-00a9bd13-5610-49ff-9528-163e55774a00 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.834821 Apr 14 16:11:54.255431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 74/155] 10.222.0.60 () {60 vars in 1145 bytes} [Wed Apr 14 16:11:53 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 837 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 14 16:11:54.270318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-57d1c261-786a-4c87-80f9-29b0b258d7ab tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Calling method '.version_select at 0x7ff58d639378>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:54.384677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-57d1c261-786a-4c87-80f9-29b0b258d7ab tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a325f94b-f51b-4a0b-af3d-3749c53fa31b" status: 200 len: 344 microversion: 2.1 time: 0.120205 Apr 14 16:11:54.385312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 75/156] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Apr 14 16:11:54 2021] GET /compute/v2.1/os-volumes/a325f94b-f51b-4a0b-af3d-3749c53fa31b => generated 344 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:54.515215 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7eb0141f-e15e-4399-b28b-66b0d9416eb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:54.516264 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7eb0141f-e15e-4399-b28b-66b0d9416eb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:54.524916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7eb0141f-e15e-4399-b28b-66b0d9416eb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:54.525572 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7eb0141f-e15e-4399-b28b-66b0d9416eb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:54.526564 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7eb0141f-e15e-4399-b28b-66b0d9416eb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:54.527210 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7eb0141f-e15e-4399-b28b-66b0d9416eb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:54.613733 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fdf0088f-65c8-44b1-bb80-d38f1a5b65ec tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:54.623307 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fdf0088f-65c8-44b1-bb80-d38f1a5b65ec tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1317 microversion: 2.1 time: 0.440414 Apr 14 16:11:54.623911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 82/157] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:54 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:11:54.679333 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7eb0141f-e15e-4399-b28b-66b0d9416eb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.169583 Apr 14 16:11:54.680008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 76/158] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:54 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:11:54.853644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9e0926b2-b1b4-45e8-96b6-0d21294abb0a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:54.854317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9e0926b2-b1b4-45e8-96b6-0d21294abb0a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:54.863112 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9e0926b2-b1b4-45e8-96b6-0d21294abb0a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:54.863540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9e0926b2-b1b4-45e8-96b6-0d21294abb0a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:54.864388 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9e0926b2-b1b4-45e8-96b6-0d21294abb0a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:54.864880 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9e0926b2-b1b4-45e8-96b6-0d21294abb0a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:55.015778 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-43035db0-fcf0-4834-89a0-29cbbccd8658 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:55.016919 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-43035db0-fcf0-4834-89a0-29cbbccd8658 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:55.025593 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43035db0-fcf0-4834-89a0-29cbbccd8658 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:55.026097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43035db0-fcf0-4834-89a0-29cbbccd8658 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:55.027012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43035db0-fcf0-4834-89a0-29cbbccd8658 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:55.027496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43035db0-fcf0-4834-89a0-29cbbccd8658 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:55.072318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9e0926b2-b1b4-45e8-96b6-0d21294abb0a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:55.093953 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9e0926b2-b1b4-45e8-96b6-0d21294abb0a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.244215 Apr 14 16:11:55.094758 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 83/159] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:54 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:55.176047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-43035db0-fcf0-4834-89a0-29cbbccd8658 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 14 microversion: 2.1 time: 0.165164 Apr 14 16:11:55.176724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 77/160] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:11:55 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:11:55.399301 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3e8e7e82-20f8-45e6-9017-0257922d0830 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Calling method '.version_select at 0x7ff58e047f28>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:55.516140 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3e8e7e82-20f8-45e6-9017-0257922d0830 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a325f94b-f51b-4a0b-af3d-3749c53fa31b" status: 200 len: 345 microversion: 2.1 time: 0.120658 Apr 14 16:11:55.516776 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 84/161] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Apr 14 16:11:55 2021] GET /compute/v2.1/os-volumes/a325f94b-f51b-4a0b-af3d-3749c53fa31b => generated 345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:55.529928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-85c7ed6c-c355-432c-ae30-77edf046cc17 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Action: 'create', calling method: .version_select at 0x7ff58e938730>, body: {"snapshot": {"volume_id": "a325f94b-f51b-4a0b-af3d-3749c53fa31b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-662245285"}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:55.641323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-dc28e122-13b6-4d33-b084-fa17c773eccf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:55.642288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-dc28e122-13b6-4d33-b084-fa17c773eccf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:55.651137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc28e122-13b6-4d33-b084-fa17c773eccf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:55.651731 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc28e122-13b6-4d33-b084-fa17c773eccf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:55.652726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc28e122-13b6-4d33-b084-fa17c773eccf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:55.653307 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc28e122-13b6-4d33-b084-fa17c773eccf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:55.799613 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-85c7ed6c-c355-432c-ae30-77edf046cc17 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.274229 Apr 14 16:11:55.800247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 78/162] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Apr 14 16:11:55 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:55.805293 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a610d8e3-c18a-479d-a896-528d8651c76b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:55.811742 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a610d8e3-c18a-479d-a896-528d8651c76b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:55.829615 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a610d8e3-c18a-479d-a896-528d8651c76b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:55.830435 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a610d8e3-c18a-479d-a896-528d8651c76b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:55.831813 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a610d8e3-c18a-479d-a896-528d8651c76b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:55.832391 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a610d8e3-c18a-479d-a896-528d8651c76b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:55.882414 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-dc28e122-13b6-4d33-b084-fa17c773eccf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:55.893337 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-dc28e122-13b6-4d33-b084-fa17c773eccf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1317 microversion: 2.1 time: 0.255919 Apr 14 16:11:55.893957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 85/163] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:55 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:55.899229 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8d85e2c6-c892-449d-9ca8-3fa4a963d164 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Calling method '.version_select at 0x7ff58e0227b8>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:55.948224 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8d85e2c6-c892-449d-9ca8-3fa4a963d164 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/1a1d6fc6-6443-4aff-ada3-348b97a03c12" status: 200 len: 286 microversion: 2.1 time: 0.052639 Apr 14 16:11:55.948915 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 86/164] 10.222.0.60 () {58 vars in 1241 bytes} [Wed Apr 14 16:11:55 2021] GET /compute/v2.1/os-snapshots/1a1d6fc6-6443-4aff-ada3-348b97a03c12 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:55.958992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8b7fe47b-5d99-445e-adf6-5f5783101397 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Calling method '.version_select at 0x7ff58ce74bf8>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:55.969577 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a610d8e3-c18a-479d-a896-528d8651c76b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14 microversion: 2.20 time: 0.167705 Apr 14 16:11:55.970331 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 79/165] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:55 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:56.002796 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8b7fe47b-5d99-445e-adf6-5f5783101397 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.047397 Apr 14 16:11:56.003430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 87/166] 10.222.0.60 () {58 vars in 1130 bytes} [Wed Apr 14 16:11:55 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:11:56.014849 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-85c5e8ba-c05d-43da-90f3-f6520d0c9d23 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Calling method '.version_select at 0x7ff58e938bf8>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:56.062940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-85c5e8ba-c05d-43da-90f3-f6520d0c9d23 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/1a1d6fc6-6443-4aff-ada3-348b97a03c12" status: 200 len: 286 microversion: 2.1 time: 0.052385 Apr 14 16:11:56.063567 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 80/167] 10.222.0.60 () {58 vars in 1241 bytes} [Wed Apr 14 16:11:56 2021] GET /compute/v2.1/os-snapshots/1a1d6fc6-6443-4aff-ada3-348b97a03c12 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:56.113163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1733e419-b16b-45a5-a194-21637f204d56 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:56.113944 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1733e419-b16b-45a5-a194-21637f204d56 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:56.123935 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1733e419-b16b-45a5-a194-21637f204d56 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:56.124560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1733e419-b16b-45a5-a194-21637f204d56 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:56.125667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1733e419-b16b-45a5-a194-21637f204d56 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:56.126242 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1733e419-b16b-45a5-a194-21637f204d56 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:56.187853 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-25de2c5b-b1eb-49bf-8f70-67c12d89edc4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:56.189325 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-25de2c5b-b1eb-49bf-8f70-67c12d89edc4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:56.198321 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25de2c5b-b1eb-49bf-8f70-67c12d89edc4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:56.198974 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25de2c5b-b1eb-49bf-8f70-67c12d89edc4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:56.200468 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25de2c5b-b1eb-49bf-8f70-67c12d89edc4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:56.201103 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25de2c5b-b1eb-49bf-8f70-67c12d89edc4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:56.352900 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1733e419-b16b-45a5-a194-21637f204d56 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:56.363431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1733e419-b16b-45a5-a194-21637f204d56 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.254440 Apr 14 16:11:56.364560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 88/168] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:56 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:56.911874 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ccda7253-52d5-4342-b369-6a8c75f3638b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:11:56.912553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ccda7253-52d5-4342-b369-6a8c75f3638b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:56.921797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccda7253-52d5-4342-b369-6a8c75f3638b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:56.922312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccda7253-52d5-4342-b369-6a8c75f3638b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:56.923174 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccda7253-52d5-4342-b369-6a8c75f3638b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:56.923674 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccda7253-52d5-4342-b369-6a8c75f3638b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:57.129560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ccda7253-52d5-4342-b369-6a8c75f3638b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:11:57.139012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ccda7253-52d5-4342-b369-6a8c75f3638b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1317 microversion: 2.1 time: 0.231256 Apr 14 16:11:57.139839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 89/169] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:11:56 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:11:57.145405 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4b365b2c-9a4d-4317-a996-b26a090b3736 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:57.146621 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4b365b2c-9a4d-4317-a996-b26a090b3736 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:11:57.156305 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4b365b2c-9a4d-4317-a996-b26a090b3736 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:57.156707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4b365b2c-9a4d-4317-a996-b26a090b3736 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:11:57.157905 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4b365b2c-9a4d-4317-a996-b26a090b3736 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:11:57.158360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4b365b2c-9a4d-4317-a996-b26a090b3736 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:00.987496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-25de2c5b-b1eb-49bf-8f70-67c12d89edc4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 14 microversion: 2.1 time: 4.803221 Apr 14 16:12:00.989340 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 81/170] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:11:56 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 14 bytes in 4806 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:12:01.004308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0e04a534-6f14-4667-97a4-f63445f26342 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Calling method '.version_select at 0x7ff58d5d1378>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:01.015698 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4b365b2c-9a4d-4317-a996-b26a090b3736 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 10580 microversion: 2.20 time: 3.874564 Apr 14 16:12:01.016481 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 90/171] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:11:57 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 10580 bytes in 3876 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:01.023855 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d0b734b2-9a9e-48da-b81b-0a9f74a9b0af tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:01.024638 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d0b734b2-9a9e-48da-b81b-0a9f74a9b0af tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:01.045317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d0b734b2-9a9e-48da-b81b-0a9f74a9b0af tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:01.045843 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d0b734b2-9a9e-48da-b81b-0a9f74a9b0af tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:01.046729 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d0b734b2-9a9e-48da-b81b-0a9f74a9b0af tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:01.047233 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d0b734b2-9a9e-48da-b81b-0a9f74a9b0af tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:01.124162 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0e04a534-6f14-4667-97a4-f63445f26342 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/1a1d6fc6-6443-4aff-ada3-348b97a03c12" status: 200 len: 286 microversion: 2.1 time: 0.132845 Apr 14 16:12:01.124823 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 82/172] 10.222.0.60 () {58 vars in 1241 bytes} [Wed Apr 14 16:12:00 2021] GET /compute/v2.1/os-snapshots/1a1d6fc6-6443-4aff-ada3-348b97a03c12 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:01.136395 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3348a383-f412-47d4-a418-56d364997dd0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:01.137587 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3348a383-f412-47d4-a418-56d364997dd0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:01.162648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3348a383-f412-47d4-a418-56d364997dd0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:01.163452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3348a383-f412-47d4-a418-56d364997dd0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:01.166002 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3348a383-f412-47d4-a418-56d364997dd0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:01.166705 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3348a383-f412-47d4-a418-56d364997dd0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:01.301419 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d0b734b2-9a9e-48da-b81b-0a9f74a9b0af tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:01.311374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d0b734b2-9a9e-48da-b81b-0a9f74a9b0af tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.293608 Apr 14 16:12:01.312027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 91/173] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:01 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:01.514150 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3348a383-f412-47d4-a418-56d364997dd0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:01.523011 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3348a383-f412-47d4-a418-56d364997dd0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1317 microversion: 2.1 time: 0.392634 Apr 14 16:12:01.523733 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 83/174] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:01 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:02.009386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a244ea1f-584f-46f7-95af-43b846379539 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:02.014553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a244ea1f-584f-46f7-95af-43b846379539 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:02.028006 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1953f682-2672-4fcb-8219-5ed6932a9e42 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:02.029317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1953f682-2672-4fcb-8219-5ed6932a9e42 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:02.035939 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a244ea1f-584f-46f7-95af-43b846379539 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:02.036405 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a244ea1f-584f-46f7-95af-43b846379539 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:02.037284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a244ea1f-584f-46f7-95af-43b846379539 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:02.037755 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a244ea1f-584f-46f7-95af-43b846379539 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:02.046759 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1953f682-2672-4fcb-8219-5ed6932a9e42 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:02.047259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1953f682-2672-4fcb-8219-5ed6932a9e42 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:02.048101 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1953f682-2672-4fcb-8219-5ed6932a9e42 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:02.048593 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1953f682-2672-4fcb-8219-5ed6932a9e42 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:02.235994 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a244ea1f-584f-46f7-95af-43b846379539 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 14 microversion: 2.1 time: 0.240229 Apr 14 16:12:02.239391 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 92/175] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:01 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 14 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:12:02.244118 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e1a23051-7b6c-4f97-93c4-ab78eb5a22dd tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Calling method '.version_select at 0x7ff58ce74620>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:02.250914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1953f682-2672-4fcb-8219-5ed6932a9e42 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 14402 microversion: 2.20 time: 0.226888 Apr 14 16:12:02.251909 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 84/176] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:02 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 14402 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:12:02.300542 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e1a23051-7b6c-4f97-93c4-ab78eb5a22dd tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/1a1d6fc6-6443-4aff-ada3-348b97a03c12" status: 200 len: 287 microversion: 2.1 time: 0.062198 Apr 14 16:12:02.301463 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 93/177] 10.222.0.60 () {58 vars in 1241 bytes} [Wed Apr 14 16:12:02 2021] GET /compute/v2.1/os-snapshots/1a1d6fc6-6443-4aff-ada3-348b97a03c12 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:02.318403 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-93d743db-cb08-408a-a7f8-500b98434dfa tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Calling method '.version_select at 0x7ff58d5d1400>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:02.330135 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-93650a38-2194-4a3d-99a9-01b79d6aef3a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:02.330951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-93650a38-2194-4a3d-99a9-01b79d6aef3a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:02.359424 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-93650a38-2194-4a3d-99a9-01b79d6aef3a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:02.364062 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-93650a38-2194-4a3d-99a9-01b79d6aef3a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:02.365924 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-93650a38-2194-4a3d-99a9-01b79d6aef3a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:02.367782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-93650a38-2194-4a3d-99a9-01b79d6aef3a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:02.475052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-93d743db-cb08-408a-a7f8-500b98434dfa tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/1a1d6fc6-6443-4aff-ada3-348b97a03c12" status: 202 len: 0 microversion: 2.1 time: 0.161711 Apr 14 16:12:02.475670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 85/178] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Apr 14 16:12:02 2021] DELETE /compute/v2.1/os-snapshots/1a1d6fc6-6443-4aff-ada3-348b97a03c12 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:02.484342 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-142e0095-5c48-40c4-8625-a4fb249f6f69 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Calling method '.version_select at 0x7ff58d639378>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:02.544820 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-142e0095-5c48-40c4-8625-a4fb249f6f69 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/1a1d6fc6-6443-4aff-ada3-348b97a03c12" status: 200 len: 286 microversion: 2.1 time: 0.064628 Apr 14 16:12:02.546036 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 86/179] 10.222.0.60 () {58 vars in 1241 bytes} [Wed Apr 14 16:12:02 2021] GET /compute/v2.1/os-snapshots/1a1d6fc6-6443-4aff-ada3-348b97a03c12 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:12:02.552866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c014e252-5b4d-4c8d-9dbe-73033cce96c0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:02.553717 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c014e252-5b4d-4c8d-9dbe-73033cce96c0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:02.564254 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c014e252-5b4d-4c8d-9dbe-73033cce96c0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:02.564773 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c014e252-5b4d-4c8d-9dbe-73033cce96c0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:02.566774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c014e252-5b4d-4c8d-9dbe-73033cce96c0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:02.567284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c014e252-5b4d-4c8d-9dbe-73033cce96c0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:02.622693 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-93650a38-2194-4a3d-99a9-01b79d6aef3a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:02.634148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-93650a38-2194-4a3d-99a9-01b79d6aef3a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.309302 Apr 14 16:12:02.635051 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 94/180] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:02 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:12:03.249061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-ec98bebe-bc53-41fc-8841-8437419fffde req-2e87eaa8-27e8-4b11-97c2-835bb054d93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce4fd86-3ba7-4f6b-8962-e1adecda486d", "name": "network-vif-plugged", "status": "completed", "tag": "6e058dba-7fbb-4a6f-9393-4264eeea9e1a"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:03.250053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:12:03.250053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:12:03.256708 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c014e252-5b4d-4c8d-9dbe-73033cce96c0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:03.269154 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-ec98bebe-bc53-41fc-8841-8437419fffde req-2e87eaa8-27e8-4b11-97c2-835bb054d93e service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:03.269670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-ec98bebe-bc53-41fc-8841-8437419fffde req-2e87eaa8-27e8-4b11-97c2-835bb054d93e service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:03.281706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c014e252-5b4d-4c8d-9dbe-73033cce96c0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1317 microversion: 2.1 time: 0.733133 Apr 14 16:12:03.282362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 87/181] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:02 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1317 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:03.291710 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ec4b672b-c04f-418e-a459-82ce24f15427 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:03.297153 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ec4b672b-c04f-418e-a459-82ce24f15427 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:03.312712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ec4b672b-c04f-418e-a459-82ce24f15427 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:03.315094 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ec4b672b-c04f-418e-a459-82ce24f15427 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:03.318192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ec4b672b-c04f-418e-a459-82ce24f15427 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:03.322960 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ec4b672b-c04f-418e-a459-82ce24f15427 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:03.323725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-ec98bebe-bc53-41fc-8841-8437419fffde req-2e87eaa8-27e8-4b11-97c2-835bb054d93e service nova] Creating event network-vif-plugged:6e058dba-7fbb-4a6f-9393-4264eeea9e1a for instance bce4fd86-3ba7-4f6b-8962-e1adecda486d on hv-cinder-78626 Apr 14 16:12:03.339158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-ec98bebe-bc53-41fc-8841-8437419fffde req-2e87eaa8-27e8-4b11-97c2-835bb054d93e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098376 Apr 14 16:12:03.343521 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 95/182] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:12:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:12:03.352363 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6ee357e2-2861-4f04-b1b9-04f97b2d0ec7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:03.363199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6ee357e2-2861-4f04-b1b9-04f97b2d0ec7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:03.405064 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ee357e2-2861-4f04-b1b9-04f97b2d0ec7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:03.412973 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ee357e2-2861-4f04-b1b9-04f97b2d0ec7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:03.414095 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ee357e2-2861-4f04-b1b9-04f97b2d0ec7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:03.414611 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ee357e2-2861-4f04-b1b9-04f97b2d0ec7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:03.570154 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ec4b672b-c04f-418e-a459-82ce24f15427 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 14 microversion: 2.1 time: 0.285888 Apr 14 16:12:03.570868 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 88/183] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:03 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 14 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:12:03.576963 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ea18db7c-9635-436c-b4e7-eeea98935a06 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Calling method '.version_select at 0x7ff58d5d1c80>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:03.629829 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6ee357e2-2861-4f04-b1b9-04f97b2d0ec7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 16721 microversion: 2.20 time: 0.284244 Apr 14 16:12:03.630547 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 96/184] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:03 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 16721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:03.654377 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-ea18db7c-9635-436c-b4e7-eeea98935a06 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] HTTP exception thrown: Snapshot 1a1d6fc6-6443-4aff-ada3-348b97a03c12 could not be found. Apr 14 16:12:03.655130 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ea18db7c-9635-436c-b4e7-eeea98935a06 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Returning 404 to user: Snapshot 1a1d6fc6-6443-4aff-ada3-348b97a03c12 could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:12:03.656000 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ea18db7c-9635-436c-b4e7-eeea98935a06 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/1a1d6fc6-6443-4aff-ada3-348b97a03c12" status: 404 len: 111 microversion: 2.1 time: 0.083947 Apr 14 16:12:03.656628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 89/185] 10.222.0.60 () {58 vars in 1241 bytes} [Wed Apr 14 16:12:03 2021] GET /compute/v2.1/os-snapshots/1a1d6fc6-6443-4aff-ada3-348b97a03c12 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:12:03.663841 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-842d147c-844f-48b6-a08a-0134cb45aec9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:03.664522 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-842d147c-844f-48b6-a08a-0134cb45aec9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:03.671910 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-13a60d69-1315-4f0b-9441-8eddcea3e0ec tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Calling method '.version_select at 0x7ff58e9388c8>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:03.674777 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-842d147c-844f-48b6-a08a-0134cb45aec9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:03.675300 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-842d147c-844f-48b6-a08a-0134cb45aec9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:03.676169 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-842d147c-844f-48b6-a08a-0134cb45aec9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:03.677054 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-842d147c-844f-48b6-a08a-0134cb45aec9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:03.874835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-13a60d69-1315-4f0b-9441-8eddcea3e0ec tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/a325f94b-f51b-4a0b-af3d-3749c53fa31b" status: 202 len: 0 microversion: 2.1 time: 0.213301 Apr 14 16:12:03.875739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 90/186] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Apr 14 16:12:03 2021] DELETE /compute/v2.1/os-volumes/a325f94b-f51b-4a0b-af3d-3749c53fa31b => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:12:03.884589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2d8ac54f-30a9-4125-b4e6-bc1dd5db4260 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Calling method '.version_select at 0x7ff58f1438c8>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:04.007121 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-842d147c-844f-48b6-a08a-0134cb45aec9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:04.020108 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-842d147c-844f-48b6-a08a-0134cb45aec9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.371731 Apr 14 16:12:04.020757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 97/187] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:03 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:04.052190 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2d8ac54f-30a9-4125-b4e6-bc1dd5db4260 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a325f94b-f51b-4a0b-af3d-3749c53fa31b" status: 200 len: 344 microversion: 2.1 time: 0.171824 Apr 14 16:12:04.057538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 91/188] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Apr 14 16:12:03 2021] GET /compute/v2.1/os-volumes/a325f94b-f51b-4a0b-af3d-3749c53fa31b => generated 344 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:04.302571 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d7b116cb-5537-4841-aa4d-6870791181b4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:04.303263 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d7b116cb-5537-4841-aa4d-6870791181b4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:04.312013 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d7b116cb-5537-4841-aa4d-6870791181b4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:04.312522 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d7b116cb-5537-4841-aa4d-6870791181b4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:04.313428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d7b116cb-5537-4841-aa4d-6870791181b4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:04.313911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d7b116cb-5537-4841-aa4d-6870791181b4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:04.519287 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d7b116cb-5537-4841-aa4d-6870791181b4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:04.529726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d7b116cb-5537-4841-aa4d-6870791181b4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1317 microversion: 2.1 time: 0.231493 Apr 14 16:12:04.530873 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 98/189] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:04 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:04.582896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a41707cf-626d-42d1-8ef8-97b260c14ba6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:04.584196 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a41707cf-626d-42d1-8ef8-97b260c14ba6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:04.597221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a41707cf-626d-42d1-8ef8-97b260c14ba6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:04.597221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a41707cf-626d-42d1-8ef8-97b260c14ba6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:04.597221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a41707cf-626d-42d1-8ef8-97b260c14ba6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:04.597221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a41707cf-626d-42d1-8ef8-97b260c14ba6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:04.643124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-48305a0b-c11a-4711-9ef2-73f20cb0d56f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:04.644179 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-48305a0b-c11a-4711-9ef2-73f20cb0d56f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:04.652152 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-48305a0b-c11a-4711-9ef2-73f20cb0d56f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:04.652642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-48305a0b-c11a-4711-9ef2-73f20cb0d56f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:04.654176 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-48305a0b-c11a-4711-9ef2-73f20cb0d56f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:04.654677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-48305a0b-c11a-4711-9ef2-73f20cb0d56f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:04.747418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a41707cf-626d-42d1-8ef8-97b260c14ba6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 14 microversion: 2.1 time: 0.168327 Apr 14 16:12:04.748309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 92/190] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:04 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 14 16:12:04.825860 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-48305a0b-c11a-4711-9ef2-73f20cb0d56f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 17717 microversion: 2.20 time: 0.185579 Apr 14 16:12:04.830894 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 99/191] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:04 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 17717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:05.040963 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6b7f6176-e74e-4541-90dd-dc4cb52ba856 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:05.041872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6b7f6176-e74e-4541-90dd-dc4cb52ba856 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:05.051395 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b7f6176-e74e-4541-90dd-dc4cb52ba856 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:05.052006 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b7f6176-e74e-4541-90dd-dc4cb52ba856 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:05.052749 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b7f6176-e74e-4541-90dd-dc4cb52ba856 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:05.053279 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b7f6176-e74e-4541-90dd-dc4cb52ba856 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:05.077411 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fe34d92b-5bea-4a50-a456-08d4e8ee6a14 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Calling method '.version_select at 0x7ff58cdd01e0>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:05.164356 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-fe34d92b-5bea-4a50-a456-08d4e8ee6a14 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] HTTP exception thrown: Volume a325f94b-f51b-4a0b-af3d-3749c53fa31b could not be found. Apr 14 16:12:05.165093 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fe34d92b-5bea-4a50-a456-08d4e8ee6a14 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Returning 404 to user: Volume a325f94b-f51b-4a0b-af3d-3749c53fa31b could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:12:05.166150 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fe34d92b-5bea-4a50-a456-08d4e8ee6a14 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a325f94b-f51b-4a0b-af3d-3749c53fa31b" status: 404 len: 109 microversion: 2.1 time: 0.103320 Apr 14 16:12:05.166864 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 100/192] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Apr 14 16:12:05 2021] GET /compute/v2.1/os-volumes/a325f94b-f51b-4a0b-af3d-3749c53fa31b => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:12:05.176781 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5cdf9e82-e061-4342-8a4f-c63b008fc783 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Calling method '.version_select at 0x7ff58e036620>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:05.247370 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-5cdf9e82-e061-4342-8a4f-c63b008fc783 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] HTTP exception thrown: Volume a325f94b-f51b-4a0b-af3d-3749c53fa31b could not be found. Apr 14 16:12:05.248041 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5cdf9e82-e061-4342-8a4f-c63b008fc783 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Returning 404 to user: Volume a325f94b-f51b-4a0b-af3d-3749c53fa31b could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:12:05.248948 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5cdf9e82-e061-4342-8a4f-c63b008fc783 tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/a325f94b-f51b-4a0b-af3d-3749c53fa31b" status: 404 len: 109 microversion: 2.1 time: 0.076209 Apr 14 16:12:05.249592 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 101/193] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Apr 14 16:12:05 2021] DELETE /compute/v2.1/os-volumes/a325f94b-f51b-4a0b-af3d-3749c53fa31b => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:12:05.258622 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-216bc9ae-e1e9-44a0-89e5-e8cd86a9cf4d tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Calling method '.version_select at 0x7ff58d71f598>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:05.362394 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-216bc9ae-e1e9-44a0-89e5-e8cd86a9cf4d tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] HTTP exception thrown: Volume a325f94b-f51b-4a0b-af3d-3749c53fa31b could not be found. Apr 14 16:12:05.363069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-216bc9ae-e1e9-44a0-89e5-e8cd86a9cf4d tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] Returning 404 to user: Volume a325f94b-f51b-4a0b-af3d-3749c53fa31b could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:12:05.363980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-216bc9ae-e1e9-44a0-89e5-e8cd86a9cf4d tempest-VolumesSnapshotsTestJSON-2038598447 tempest-VolumesSnapshotsTestJSON-2038598447-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a325f94b-f51b-4a0b-af3d-3749c53fa31b" status: 404 len: 109 microversion: 2.1 time: 0.109903 Apr 14 16:12:05.364583 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 102/194] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Apr 14 16:12:05 2021] GET /compute/v2.1/os-volumes/a325f94b-f51b-4a0b-af3d-3749c53fa31b => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 16:12:05.440689 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6b7f6176-e74e-4541-90dd-dc4cb52ba856 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:05.453587 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6b7f6176-e74e-4541-90dd-dc4cb52ba856 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.416760 Apr 14 16:12:05.464517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 93/195] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:05 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:05.552604 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-33932534-a5c0-4f5f-9a01-8c7c6bd3a13a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:05.553443 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-33932534-a5c0-4f5f-9a01-8c7c6bd3a13a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:05.562612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-33932534-a5c0-4f5f-9a01-8c7c6bd3a13a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:05.563349 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-33932534-a5c0-4f5f-9a01-8c7c6bd3a13a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:05.564229 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-33932534-a5c0-4f5f-9a01-8c7c6bd3a13a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:05.564731 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-33932534-a5c0-4f5f-9a01-8c7c6bd3a13a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:05.759217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4a8bccfa-0274-41af-beee-122a5e9489fa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:05.760913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4a8bccfa-0274-41af-beee-122a5e9489fa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:05.769929 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4a8bccfa-0274-41af-beee-122a5e9489fa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:05.770695 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4a8bccfa-0274-41af-beee-122a5e9489fa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:05.772284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4a8bccfa-0274-41af-beee-122a5e9489fa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:05.773150 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4a8bccfa-0274-41af-beee-122a5e9489fa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:05.865586 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-33932534-a5c0-4f5f-9a01-8c7c6bd3a13a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:05.881303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-33932534-a5c0-4f5f-9a01-8c7c6bd3a13a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1506 microversion: 2.1 time: 0.335867 Apr 14 16:12:05.882412 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 103/196] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:05 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:05.890886 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c29db1e4-cc9b-425e-b428-6f9a46cbffb8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:05.893011 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c29db1e4-cc9b-425e-b428-6f9a46cbffb8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:05.908945 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c29db1e4-cc9b-425e-b428-6f9a46cbffb8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:05.913342 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c29db1e4-cc9b-425e-b428-6f9a46cbffb8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:05.915237 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4a8bccfa-0274-41af-beee-122a5e9489fa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 14 microversion: 2.1 time: 0.159855 Apr 14 16:12:05.915955 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 94/197] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:05 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:12:05.916920 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c29db1e4-cc9b-425e-b428-6f9a46cbffb8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:05.917919 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c29db1e4-cc9b-425e-b428-6f9a46cbffb8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:05.922517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-763c1994-18dd-4aa2-a4ca-c3feed61e5d0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ccea1e8-8ae8-4193-a318-28bd0f1bc636"}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:05.923819 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-763c1994-18dd-4aa2-a4ca-c3feed61e5d0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:05.944190 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-763c1994-18dd-4aa2-a4ca-c3feed61e5d0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:05.944697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-763c1994-18dd-4aa2-a4ca-c3feed61e5d0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:05.945569 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-763c1994-18dd-4aa2-a4ca-c3feed61e5d0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:05.948396 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-763c1994-18dd-4aa2-a4ca-c3feed61e5d0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:06.101884 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c29db1e4-cc9b-425e-b428-6f9a46cbffb8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 17744 microversion: 2.20 time: 0.217399 Apr 14 16:12:06.107996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 104/198] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:05 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 17744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:06.223790 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-763c1994-18dd-4aa2-a4ca-c3feed61e5d0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] HTTP exception thrown: Invalid volume: volume 2ccea1e8-8ae8-4193-a318-28bd0f1bc636 is already attached to instances: 3e0bacb9-233d-4561-9882-6c9619a84e69 Apr 14 16:12:06.224669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-763c1994-18dd-4aa2-a4ca-c3feed61e5d0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Returning 400 to user: Invalid volume: volume 2ccea1e8-8ae8-4193-a318-28bd0f1bc636 is already attached to instances: 3e0bacb9-233d-4561-9882-6c9619a84e69 {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:12:06.225882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-763c1994-18dd-4aa2-a4ca-c3feed61e5d0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "POST /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.308464 Apr 14 16:12:06.226834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 95/199] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Apr 14 16:12:05 2021] POST /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d/os-volume_attachments => generated 174 bytes in 310 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 16:12:06.371443 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bc90843b-d12f-403b-a6af-715319707680 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:06.374509 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bc90843b-d12f-403b-a6af-715319707680 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:06.395745 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bc90843b-d12f-403b-a6af-715319707680 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:06.398323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bc90843b-d12f-403b-a6af-715319707680 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:06.399397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bc90843b-d12f-403b-a6af-715319707680 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:06.402281 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bc90843b-d12f-403b-a6af-715319707680 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:06.472640 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e9fb5e3b-dd9a-464c-94ee-e96bcaf7b1e1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:06.473253 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e9fb5e3b-dd9a-464c-94ee-e96bcaf7b1e1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:06.490967 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e9fb5e3b-dd9a-464c-94ee-e96bcaf7b1e1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:06.491476 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e9fb5e3b-dd9a-464c-94ee-e96bcaf7b1e1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:06.492344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e9fb5e3b-dd9a-464c-94ee-e96bcaf7b1e1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:06.492843 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e9fb5e3b-dd9a-464c-94ee-e96bcaf7b1e1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:06.726428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-bc90843b-d12f-403b-a6af-715319707680 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lazy-loading 'services' on Instance uuid 3e0bacb9-233d-4561-9882-6c9619a84e69 {{(pid=99335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:12:06.977969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bc90843b-d12f-403b-a6af-715319707680 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69/os-volume_attachments/2ccea1e8-8ae8-4193-a318-28bd0f1bc636" status: 202 len: 0 microversion: 2.1 time: 0.611973 Apr 14 16:12:06.979181 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 105/200] 10.222.0.60 () {58 vars in 1406 bytes} [Wed Apr 14 16:12:06 2021] DELETE /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69/os-volume_attachments/2ccea1e8-8ae8-4193-a318-28bd0f1bc636 => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:07.013091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bee058e8-958a-4df6-bc64-4f1588f95de5 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:07.017286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bee058e8-958a-4df6-bc64-4f1588f95de5 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:07.021668 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e9fb5e3b-dd9a-464c-94ee-e96bcaf7b1e1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:07.034480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e9fb5e3b-dd9a-464c-94ee-e96bcaf7b1e1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.565935 Apr 14 16:12:07.038653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 96/201] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:06 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:12:07.050253 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bee058e8-958a-4df6-bc64-4f1588f95de5 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:07.050834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bee058e8-958a-4df6-bc64-4f1588f95de5 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:07.051980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bee058e8-958a-4df6-bc64-4f1588f95de5 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:07.052704 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bee058e8-958a-4df6-bc64-4f1588f95de5 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:07.115563 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-117fc9e1-9bfd-4f83-9ba6-1300411914b7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:07.116977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-117fc9e1-9bfd-4f83-9ba6-1300411914b7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:07.147073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-117fc9e1-9bfd-4f83-9ba6-1300411914b7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:07.147589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-117fc9e1-9bfd-4f83-9ba6-1300411914b7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:07.148479 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-117fc9e1-9bfd-4f83-9ba6-1300411914b7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:07.148979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-117fc9e1-9bfd-4f83-9ba6-1300411914b7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:07.305688 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bee058e8-958a-4df6-bc64-4f1588f95de5 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 14 microversion: 2.1 time: 0.324372 Apr 14 16:12:07.306827 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 106/202] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:06 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 14 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:12:07.347084 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-117fc9e1-9bfd-4f83-9ba6-1300411914b7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 19342 microversion: 2.20 time: 0.235242 Apr 14 16:12:07.352092 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 97/203] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:07 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 19342 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:08.056677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7b5d7893-f8b9-4c78-a8bc-c79d7252a737 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:08.068210 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7b5d7893-f8b9-4c78-a8bc-c79d7252a737 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:08.107048 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7b5d7893-f8b9-4c78-a8bc-c79d7252a737 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:08.111574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7b5d7893-f8b9-4c78-a8bc-c79d7252a737 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:08.112620 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7b5d7893-f8b9-4c78-a8bc-c79d7252a737 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:08.115565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7b5d7893-f8b9-4c78-a8bc-c79d7252a737 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:08.319519 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-29c00560-7166-4baf-9201-b96791beeb8d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:08.320587 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-29c00560-7166-4baf-9201-b96791beeb8d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:08.333375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29c00560-7166-4baf-9201-b96791beeb8d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:08.334183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29c00560-7166-4baf-9201-b96791beeb8d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:08.335214 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29c00560-7166-4baf-9201-b96791beeb8d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:08.335861 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29c00560-7166-4baf-9201-b96791beeb8d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:08.503618 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-29c00560-7166-4baf-9201-b96791beeb8d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 4153 microversion: 2.1 time: 0.188453 Apr 14 16:12:08.504945 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 98/204] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:08 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 4153 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:08.510966 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-404e8574-fd92-401e-883a-83685b250718 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:08.515365 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-404e8574-fd92-401e-883a-83685b250718 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:08.534038 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-404e8574-fd92-401e-883a-83685b250718 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:08.536745 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-404e8574-fd92-401e-883a-83685b250718 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:08.538184 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-404e8574-fd92-401e-883a-83685b250718 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:08.538184 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-404e8574-fd92-401e-883a-83685b250718 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:08.564916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7b5d7893-f8b9-4c78-a8bc-c79d7252a737 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:08.583274 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7b5d7893-f8b9-4c78-a8bc-c79d7252a737 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.531142 Apr 14 16:12:08.584023 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 107/205] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:08 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:08.752946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-404e8574-fd92-401e-883a-83685b250718 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 20909 microversion: 2.20 time: 0.246127 Apr 14 16:12:08.753708 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 99/206] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:08 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 20909 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:09.516178 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a31bd020-f198-4bb4-93ad-d89ba4b9a110 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:09.518035 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a31bd020-f198-4bb4-93ad-d89ba4b9a110 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:09.535201 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a31bd020-f198-4bb4-93ad-d89ba4b9a110 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:09.535687 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a31bd020-f198-4bb4-93ad-d89ba4b9a110 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:09.536556 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a31bd020-f198-4bb4-93ad-d89ba4b9a110 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:09.537082 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a31bd020-f198-4bb4-93ad-d89ba4b9a110 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:09.601657 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-474040dc-31e4-4aab-a6ea-7a7d9ce64b6a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:09.602663 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-474040dc-31e4-4aab-a6ea-7a7d9ce64b6a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:09.624349 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-474040dc-31e4-4aab-a6ea-7a7d9ce64b6a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:09.625159 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-474040dc-31e4-4aab-a6ea-7a7d9ce64b6a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:09.626170 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-474040dc-31e4-4aab-a6ea-7a7d9ce64b6a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:09.626822 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-474040dc-31e4-4aab-a6ea-7a7d9ce64b6a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:09.750080 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a31bd020-f198-4bb4-93ad-d89ba4b9a110 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 8578 microversion: 2.1 time: 0.237995 Apr 14 16:12:09.752456 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 108/207] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:09 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 8578 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:09.768141 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8c34ea8f-4236-4b29-9554-393fe82843a1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:09.769842 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8c34ea8f-4236-4b29-9554-393fe82843a1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:09.816265 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8c34ea8f-4236-4b29-9554-393fe82843a1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:09.818733 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8c34ea8f-4236-4b29-9554-393fe82843a1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:09.829230 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8c34ea8f-4236-4b29-9554-393fe82843a1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:09.831896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8c34ea8f-4236-4b29-9554-393fe82843a1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:10.069995 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8c34ea8f-4236-4b29-9554-393fe82843a1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 21929 microversion: 2.20 time: 0.309433 Apr 14 16:12:10.071421 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 109/208] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:09 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 21929 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:10.077284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e90291b1-dfba-4865-8c2e-b56cc15aa183 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] Calling method '.version_select at 0x7ff58e036ea0>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:10.191292 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e90291b1-dfba-4865-8c2e-b56cc15aa183 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3aeb142f-bb1b-4671-a2be-df522a290c10" status: 200 len: 351 microversion: 2.1 time: 0.119244 Apr 14 16:12:10.192135 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 110/209] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Apr 14 16:12:10 2021] GET /compute/v2.1/os-volumes/3aeb142f-bb1b-4671-a2be-df522a290c10 => generated 351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:10.204060 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-510157583", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452", "networks": [{"uuid": "2513cfaf-5700-4daa-9c93-a6579fd80809"}]}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:10.334423 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-474040dc-31e4-4aab-a6ea-7a7d9ce64b6a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:10.345316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-474040dc-31e4-4aab-a6ea-7a7d9ce64b6a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.748015 Apr 14 16:12:10.347637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 100/210] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:09 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:10.765149 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a1ab4071-0459-42cd-9337-cf371f26368f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:10.769303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a1ab4071-0459-42cd-9337-cf371f26368f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:10.796334 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a1ab4071-0459-42cd-9337-cf371f26368f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:10.804262 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a1ab4071-0459-42cd-9337-cf371f26368f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:10.806289 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a1ab4071-0459-42cd-9337-cf371f26368f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:10.810820 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a1ab4071-0459-42cd-9337-cf371f26368f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:11.036670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a1ab4071-0459-42cd-9337-cf371f26368f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 12936 microversion: 2.1 time: 0.274893 Apr 14 16:12:11.037438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 101/211] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:10 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 12936 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:12:11.084060 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bc7420f7-68dc-4379-85d9-c2142315a30c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:11.085649 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bc7420f7-68dc-4379-85d9-c2142315a30c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:11.098826 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bc7420f7-68dc-4379-85d9-c2142315a30c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:11.099554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bc7420f7-68dc-4379-85d9-c2142315a30c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:11.100562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bc7420f7-68dc-4379-85d9-c2142315a30c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:11.101252 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bc7420f7-68dc-4379-85d9-c2142315a30c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:11.258434 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bc7420f7-68dc-4379-85d9-c2142315a30c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 22973 microversion: 2.20 time: 0.178913 Apr 14 16:12:11.260143 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 102/212] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:11 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 22973 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:11.366530 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9bdd89b4-f94e-4fd6-9958-5d5152c28337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:11.367686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9bdd89b4-f94e-4fd6-9958-5d5152c28337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:11.380590 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9bdd89b4-f94e-4fd6-9958-5d5152c28337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:11.381497 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9bdd89b4-f94e-4fd6-9958-5d5152c28337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:11.383228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9bdd89b4-f94e-4fd6-9958-5d5152c28337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:11.384297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9bdd89b4-f94e-4fd6-9958-5d5152c28337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:11.724327 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9bdd89b4-f94e-4fd6-9958-5d5152c28337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:11.746442 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9bdd89b4-f94e-4fd6-9958-5d5152c28337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.385034 Apr 14 16:12:11.748325 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 103/213] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:11 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:12:12.048649 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f4ef3bc7-0128-4a82-8619-4cdfae0bf437 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:12.049750 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f4ef3bc7-0128-4a82-8619-4cdfae0bf437 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:12.067755 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f4ef3bc7-0128-4a82-8619-4cdfae0bf437 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:12.068445 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f4ef3bc7-0128-4a82-8619-4cdfae0bf437 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:12.070609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f4ef3bc7-0128-4a82-8619-4cdfae0bf437 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:12.071365 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f4ef3bc7-0128-4a82-8619-4cdfae0bf437 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:12.287597 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f4ef3bc7-0128-4a82-8619-4cdfae0bf437 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 15480 microversion: 2.1 time: 0.242965 Apr 14 16:12:12.288288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 104/214] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:12 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 15480 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:12:12.297691 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4429194c-f549-4551-8b0e-7818a560e388 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] Calling method '.version_select at 0x7ff58d5d11e0>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:12.533690 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4429194c-f549-4551-8b0e-7818a560e388 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/72fc3af2-2196-49c9-a26c-005208d5a38e" status: 200 len: 351 microversion: 2.1 time: 0.240584 Apr 14 16:12:12.534750 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 105/215] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Apr 14 16:12:12 2021] GET /compute/v2.1/os-volumes/72fc3af2-2196-49c9-a26c-005208d5a38e => generated 351 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:12.541237 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5f0654e7-0210-4b12-a097-ca8fc1d7cf9e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:12.549737 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5f0654e7-0210-4b12-a097-ca8fc1d7cf9e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:12.580585 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f0654e7-0210-4b12-a097-ca8fc1d7cf9e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:12.581476 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f0654e7-0210-4b12-a097-ca8fc1d7cf9e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:12.582568 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f0654e7-0210-4b12-a097-ca8fc1d7cf9e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:12.583347 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f0654e7-0210-4b12-a097-ca8fc1d7cf9e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:12.806666 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5f0654e7-0210-4b12-a097-ca8fc1d7cf9e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 23794 microversion: 2.20 time: 0.270307 Apr 14 16:12:12.807781 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 106/216] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:12 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 23794 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:12.812983 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f429d132-a347-4ca6-9da8-f62320e3a995 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:12.814515 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f429d132-a347-4ca6-9da8-f62320e3a995 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:12.829700 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f429d132-a347-4ca6-9da8-f62320e3a995 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:12.830480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f429d132-a347-4ca6-9da8-f62320e3a995 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:12.831322 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f429d132-a347-4ca6-9da8-f62320e3a995 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:12.831897 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f429d132-a347-4ca6-9da8-f62320e3a995 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:13.152625 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f429d132-a347-4ca6-9da8-f62320e3a995 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:13.173271 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f429d132-a347-4ca6-9da8-f62320e3a995 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.364220 Apr 14 16:12:13.173951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 107/217] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:12 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:13.300006 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6cea6b50-de0f-4421-8169-33a351ff52f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:13.301079 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6cea6b50-de0f-4421-8169-33a351ff52f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:13.317391 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6cea6b50-de0f-4421-8169-33a351ff52f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:13.317907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6cea6b50-de0f-4421-8169-33a351ff52f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:13.318787 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6cea6b50-de0f-4421-8169-33a351ff52f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:13.319286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6cea6b50-de0f-4421-8169-33a351ff52f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:13.524959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6cea6b50-de0f-4421-8169-33a351ff52f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 17686 microversion: 2.1 time: 0.228849 Apr 14 16:12:13.529138 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 108/218] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:13 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 17686 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:12:13.822544 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8230286c-b247-4001-841e-6a15d606e8b7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:13.829667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8230286c-b247-4001-841e-6a15d606e8b7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:13.839805 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8230286c-b247-4001-841e-6a15d606e8b7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:13.840350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8230286c-b247-4001-841e-6a15d606e8b7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:13.841224 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8230286c-b247-4001-841e-6a15d606e8b7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:13.841723 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8230286c-b247-4001-841e-6a15d606e8b7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:14.040028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8230286c-b247-4001-841e-6a15d606e8b7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 24468 microversion: 2.20 time: 0.223955 Apr 14 16:12:14.040933 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 109/219] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:13 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 24468 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:12:14.193890 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-29f62ec5-32ad-4917-a687-d3d3512fee76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:14.195883 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-29f62ec5-32ad-4917-a687-d3d3512fee76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:14.206701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29f62ec5-32ad-4917-a687-d3d3512fee76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:14.207595 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29f62ec5-32ad-4917-a687-d3d3512fee76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:14.208722 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29f62ec5-32ad-4917-a687-d3d3512fee76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:14.209490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29f62ec5-32ad-4917-a687-d3d3512fee76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:14.574385 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-29f62ec5-32ad-4917-a687-d3d3512fee76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:14.607073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] validate_networks() for [('2513cfaf-5700-4daa-9c93-a6579fd80809', None, None, None)] {{(pid=99335) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:12:14.617496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-29f62ec5-32ad-4917-a687-d3d3512fee76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.429495 Apr 14 16:12:14.618472 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 110/220] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:14 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:14.624403 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2c7b5f67-e896-453b-a333-98d1529e39e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:14.625487 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2c7b5f67-e896-453b-a333-98d1529e39e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:14.633940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2c7b5f67-e896-453b-a333-98d1529e39e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:14.634603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2c7b5f67-e896-453b-a333-98d1529e39e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:14.635532 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2c7b5f67-e896-453b-a333-98d1529e39e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:14.636117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2c7b5f67-e896-453b-a333-98d1529e39e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:14.837880 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2c7b5f67-e896-453b-a333-98d1529e39e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 17841 microversion: 2.1 time: 0.217812 Apr 14 16:12:14.838744 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 111/221] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:14 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 17841 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:14.849648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fc1d494a-767f-40b6-acde-c3c4da906414 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] Calling method '.version_select at 0x7ff58d41f620>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:15.001909 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fc1d494a-767f-40b6-acde-c3c4da906414 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/75fa74e3-30ed-4014-b457-a7339d5d1a89" status: 200 len: 350 microversion: 2.1 time: 0.161576 Apr 14 16:12:15.003153 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 112/222] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Apr 14 16:12:14 2021] GET /compute/v2.1/os-volumes/75fa74e3-30ed-4014-b457-a7339d5d1a89 => generated 350 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:15.018624 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f004f0a6-e8f0-46fd-b6f3-2d59fe385088 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] Calling method '.version_select at 0x7ff58d530e18>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:15.192981 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f004f0a6-e8f0-46fd-b6f3-2d59fe385088 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.179663 Apr 14 16:12:15.194007 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 113/223] 10.222.0.60 () {58 vars in 1124 bytes} [Wed Apr 14 16:12:15 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:15.201361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e827d527-9ec0-473a-82fd-7c1e6559be76 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:15.202906 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e827d527-9ec0-473a-82fd-7c1e6559be76 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:15.212882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e827d527-9ec0-473a-82fd-7c1e6559be76 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:15.213681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e827d527-9ec0-473a-82fd-7c1e6559be76 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:15.214979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e827d527-9ec0-473a-82fd-7c1e6559be76 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:15.218093 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e827d527-9ec0-473a-82fd-7c1e6559be76 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:15.402441 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e827d527-9ec0-473a-82fd-7c1e6559be76 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 25100 microversion: 2.20 time: 0.205318 Apr 14 16:12:15.405066 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 114/224] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:15 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 25100 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:15.411225 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2b288c49-9283-4942-bd68-3c35dcda0259 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] Calling method '.version_select at 0x7ff58d530488>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:15.486454 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Flavor limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:12:15.487322 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Image limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:12:15.488229 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Flavor pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:12:15.488783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Image pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:12:15.489580 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:12:15.500213 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:15.500883 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:15.501897 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:15.502517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:15.521857 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2b288c49-9283-4942-bd68-3c35dcda0259 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.115295 Apr 14 16:12:15.522678 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 115/225] 10.222.0.60 () {58 vars in 1139 bytes} [Wed Apr 14 16:12:15 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:15.524835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Getting quotas for project b8a4298bacf14cd493bcec2e3543ab00. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:12:15.530080 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Getting quotas for user 8a19cff22a01451e8d454b8a8f4cde89 and project b8a4298bacf14cd493bcec2e3543ab00. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:12:15.537375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-aee0a447-023e-430d-a183-61e57d74f17c tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] Calling method '.version_select at 0x7ff58d41f400>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:15.546778 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Going to run 1 instances... {{(pid=99335) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:12:15.550523 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:12:15.606343 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c3ae06c8-f4e1-428c-8360-4d9d78328075 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.412727 Apr 14 16:12:15.607272 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 111/226] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:12:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 5415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:12:15.617924 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4d5667f9-1c74-454d-b85d-39a1566b4bcb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:15.619061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4d5667f9-1c74-454d-b85d-39a1566b4bcb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:15.662758 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-aee0a447-023e-430d-a183-61e57d74f17c tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.129600 Apr 14 16:12:15.663882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 116/227] 10.222.0.60 () {58 vars in 1124 bytes} [Wed Apr 14 16:12:15 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:12:15.669418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-96c3b9c9-732d-42e1-9622-ec42349bd110 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:15.670382 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-96c3b9c9-732d-42e1-9622-ec42349bd110 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:15.679820 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-96c3b9c9-732d-42e1-9622-ec42349bd110 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:15.680327 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-96c3b9c9-732d-42e1-9622-ec42349bd110 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:15.681191 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-96c3b9c9-732d-42e1-9622-ec42349bd110 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:15.681680 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-96c3b9c9-732d-42e1-9622-ec42349bd110 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:15.766464 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4d5667f9-1c74-454d-b85d-39a1566b4bcb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:15.775599 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4d5667f9-1c74-454d-b85d-39a1566b4bcb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1217 microversion: 2.1 time: 0.161637 Apr 14 16:12:15.776302 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 112/228] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:15 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:15.784346 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-47638d7f-9ac3-499d-88ea-a3390769405a tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] Calling method '.version_select at 0x7ff58e047e18>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:15.960766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-47638d7f-9ac3-499d-88ea-a3390769405a tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.182720 Apr 14 16:12:15.969816 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 113/229] 10.222.0.60 () {58 vars in 1157 bytes} [Wed Apr 14 16:12:15 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:15.981088 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d93b6d9b-a78b-4711-904b-e60f81e34ba4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:15.982673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d93b6d9b-a78b-4711-904b-e60f81e34ba4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:16.017218 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d93b6d9b-a78b-4711-904b-e60f81e34ba4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:16.017950 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d93b6d9b-a78b-4711-904b-e60f81e34ba4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:16.019536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d93b6d9b-a78b-4711-904b-e60f81e34ba4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:16.020413 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d93b6d9b-a78b-4711-904b-e60f81e34ba4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:16.094352 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-96c3b9c9-732d-42e1-9622-ec42349bd110 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:16.107242 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-96c3b9c9-732d-42e1-9622-ec42349bd110 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.441766 Apr 14 16:12:16.108449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 117/230] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:15 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:16.155509 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-aee66173-34ee-45e0-9e4f-e86eb1c6b1f0 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] Calling method '.version_select at 0x7ff58d41f620>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:16.288386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-aee66173-34ee-45e0-9e4f-e86eb1c6b1f0 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.155429 Apr 14 16:12:16.289087 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 118/231] 10.222.0.60 () {58 vars in 1160 bytes} [Wed Apr 14 16:12:16 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:16.302089 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b5fc2629-3a6d-421f-a873-ecf6a4b4606a tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] Calling method '.version_select at 0x7ff58d5d11e0>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:16.317473 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d93b6d9b-a78b-4711-904b-e60f81e34ba4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 19342 microversion: 2.1 time: 0.345849 Apr 14 16:12:16.319113 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 114/232] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:15 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 19342 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:16.417024 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-31efa0dc-607e-47d2-8c5f-3ae7429aea74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:16.418996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-31efa0dc-607e-47d2-8c5f-3ae7429aea74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:16.434636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-31efa0dc-607e-47d2-8c5f-3ae7429aea74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:16.435145 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-31efa0dc-607e-47d2-8c5f-3ae7429aea74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:16.436000 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-31efa0dc-607e-47d2-8c5f-3ae7429aea74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:16.436489 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-31efa0dc-607e-47d2-8c5f-3ae7429aea74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:16.470387 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b5fc2629-3a6d-421f-a873-ecf6a4b4606a tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.172085 Apr 14 16:12:16.471338 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 119/233] 10.222.0.60 () {58 vars in 1145 bytes} [Wed Apr 14 16:12:16 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:16.492517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-76b02a7f-64fb-4f53-afde-199b78b72d37 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] Calling method '.version_select at 0x7ff58d409730>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:16.613345 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-31efa0dc-607e-47d2-8c5f-3ae7429aea74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 25669 microversion: 2.20 time: 0.199931 Apr 14 16:12:16.617947 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 115/234] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:16 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 25669 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:12:16.630218 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-76b02a7f-64fb-4f53-afde-199b78b72d37 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.142252 Apr 14 16:12:16.630839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 120/235] 10.222.0.60 () {58 vars in 1178 bytes} [Wed Apr 14 16:12:16 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:16.644684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b80e4eb9-888c-4914-a44c-0f2615b03392 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] Calling method '.version_select at 0x7ff58cc46c80>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:16.751621 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b80e4eb9-888c-4914-a44c-0f2615b03392 tempest-VolumesTestJSON-707970105 tempest-VolumesTestJSON-707970105-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.111117 Apr 14 16:12:16.752761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 116/236] 10.222.0.60 () {58 vars in 1145 bytes} [Wed Apr 14 16:12:16 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:12:16.796169 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9c771fe5-330b-42cc-86db-11a77afb220f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:16.797119 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9c771fe5-330b-42cc-86db-11a77afb220f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:16.813329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c771fe5-330b-42cc-86db-11a77afb220f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:16.815947 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c771fe5-330b-42cc-86db-11a77afb220f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:16.817718 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c771fe5-330b-42cc-86db-11a77afb220f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:16.822300 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c771fe5-330b-42cc-86db-11a77afb220f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:17.050660 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9c771fe5-330b-42cc-86db-11a77afb220f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:17.060680 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9c771fe5-330b-42cc-86db-11a77afb220f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1269 microversion: 2.1 time: 0.269032 Apr 14 16:12:17.061563 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 121/237] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:16 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1269 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:17.127706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-46cb7839-5254-4df9-9821-302cca70ccd8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:17.128413 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-46cb7839-5254-4df9-9821-302cca70ccd8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:17.156355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-46cb7839-5254-4df9-9821-302cca70ccd8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:17.160294 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-46cb7839-5254-4df9-9821-302cca70ccd8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:17.161200 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-46cb7839-5254-4df9-9821-302cca70ccd8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:17.161692 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-46cb7839-5254-4df9-9821-302cca70ccd8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:17.330982 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5040003b-7182-43ca-b5b8-4905dc097e1f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:17.332921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5040003b-7182-43ca-b5b8-4905dc097e1f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:17.349958 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5040003b-7182-43ca-b5b8-4905dc097e1f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:17.350733 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5040003b-7182-43ca-b5b8-4905dc097e1f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:17.351865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5040003b-7182-43ca-b5b8-4905dc097e1f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:17.352511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5040003b-7182-43ca-b5b8-4905dc097e1f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:17.444608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-46cb7839-5254-4df9-9821-302cca70ccd8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:17.477018 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-46cb7839-5254-4df9-9821-302cca70ccd8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.347049 Apr 14 16:12:17.489339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 117/238] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:17 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:12:17.540859 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5040003b-7182-43ca-b5b8-4905dc097e1f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 20990 microversion: 2.1 time: 0.212858 Apr 14 16:12:17.541901 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 122/239] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:17 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 20990 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:17.630480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-689c7afa-6a6d-4394-9fa2-604a03ad2799 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:17.632197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-689c7afa-6a6d-4394-9fa2-604a03ad2799 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:17.646247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-689c7afa-6a6d-4394-9fa2-604a03ad2799 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:17.647072 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-689c7afa-6a6d-4394-9fa2-604a03ad2799 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:17.648489 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-689c7afa-6a6d-4394-9fa2-604a03ad2799 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:17.649410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-689c7afa-6a6d-4394-9fa2-604a03ad2799 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:17.814558 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-689c7afa-6a6d-4394-9fa2-604a03ad2799 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 26337 microversion: 2.20 time: 0.187652 Apr 14 16:12:17.815932 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 118/240] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:17 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 26337 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:18.081774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4e87ed94-b2ce-4423-94d1-07afbe25b9ed tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:18.082766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4e87ed94-b2ce-4423-94d1-07afbe25b9ed tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:18.101956 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4e87ed94-b2ce-4423-94d1-07afbe25b9ed tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:18.106787 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4e87ed94-b2ce-4423-94d1-07afbe25b9ed tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:18.107588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4e87ed94-b2ce-4423-94d1-07afbe25b9ed tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:18.108076 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4e87ed94-b2ce-4423-94d1-07afbe25b9ed tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:18.327280 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4e87ed94-b2ce-4423-94d1-07afbe25b9ed tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:18.339610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4e87ed94-b2ce-4423-94d1-07afbe25b9ed tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1275 microversion: 2.1 time: 0.263357 Apr 14 16:12:18.341633 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 123/241] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:18 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1275 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:18.502480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-26e937b8-a9db-4953-8aab-89409b5664a6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:18.503405 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-26e937b8-a9db-4953-8aab-89409b5664a6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:18.518085 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26e937b8-a9db-4953-8aab-89409b5664a6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:18.518630 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26e937b8-a9db-4953-8aab-89409b5664a6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:18.519488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26e937b8-a9db-4953-8aab-89409b5664a6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:18.519978 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26e937b8-a9db-4953-8aab-89409b5664a6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:18.552983 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cfd08d5e-96be-4a92-8607-258763d43ee7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:18.554215 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cfd08d5e-96be-4a92-8607-258763d43ee7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:18.567942 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cfd08d5e-96be-4a92-8607-258763d43ee7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:18.570044 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cfd08d5e-96be-4a92-8607-258763d43ee7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:18.570929 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cfd08d5e-96be-4a92-8607-258763d43ee7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:18.571420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cfd08d5e-96be-4a92-8607-258763d43ee7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:18.788783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cfd08d5e-96be-4a92-8607-258763d43ee7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 22080 microversion: 2.1 time: 0.238916 Apr 14 16:12:18.793189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 124/242] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:18 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 22080 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:18.828711 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a0c7e071-8416-4ffd-925f-37fff12e9847 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:18.830021 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a0c7e071-8416-4ffd-925f-37fff12e9847 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:18.839224 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0c7e071-8416-4ffd-925f-37fff12e9847 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:18.839730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0c7e071-8416-4ffd-925f-37fff12e9847 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:18.840639 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0c7e071-8416-4ffd-925f-37fff12e9847 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:18.841296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0c7e071-8416-4ffd-925f-37fff12e9847 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:18.995784 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a0c7e071-8416-4ffd-925f-37fff12e9847 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 26948 microversion: 2.20 time: 0.170339 Apr 14 16:12:18.996011 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-26e937b8-a9db-4953-8aab-89409b5664a6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:19.001364 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 125/243] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:18 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 26948 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:12:19.014083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-26e937b8-a9db-4953-8aab-89409b5664a6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.515963 Apr 14 16:12:19.021466 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 119/244] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:18 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:19.360653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3827fdf6-0200-4a3f-87b5-375653f47b12 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:19.361767 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3827fdf6-0200-4a3f-87b5-375653f47b12 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:19.377573 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3827fdf6-0200-4a3f-87b5-375653f47b12 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:19.381200 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3827fdf6-0200-4a3f-87b5-375653f47b12 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:19.382339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3827fdf6-0200-4a3f-87b5-375653f47b12 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:19.382946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3827fdf6-0200-4a3f-87b5-375653f47b12 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:19.717422 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3827fdf6-0200-4a3f-87b5-375653f47b12 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:19.728490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3827fdf6-0200-4a3f-87b5-375653f47b12 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1317 microversion: 2.1 time: 0.372529 Apr 14 16:12:19.729675 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 126/245] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:19 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:19.802994 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3a9ca3ed-b094-4a81-ade5-d9b34e6377df tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:19.804062 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3a9ca3ed-b094-4a81-ade5-d9b34e6377df tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:19.825817 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3a9ca3ed-b094-4a81-ade5-d9b34e6377df tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:19.825817 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3a9ca3ed-b094-4a81-ade5-d9b34e6377df tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:19.827166 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3a9ca3ed-b094-4a81-ade5-d9b34e6377df tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:19.827673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3a9ca3ed-b094-4a81-ade5-d9b34e6377df tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:20.014913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-07e02170-9379-4cd5-b295-609e6e305c48 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:20.016061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-07e02170-9379-4cd5-b295-609e6e305c48 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:20.036374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-07e02170-9379-4cd5-b295-609e6e305c48 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:20.046047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-07e02170-9379-4cd5-b295-609e6e305c48 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:20.047378 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-07e02170-9379-4cd5-b295-609e6e305c48 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:20.047916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-07e02170-9379-4cd5-b295-609e6e305c48 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:20.059920 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3a9ca3ed-b094-4a81-ade5-d9b34e6377df tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 23124 microversion: 2.1 time: 0.260317 Apr 14 16:12:20.061498 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 120/246] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:19 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 23124 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:20.067228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f3356c0a-d27d-4db7-b0d1-7e00c0f0fb0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:20.070547 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f3356c0a-d27d-4db7-b0d1-7e00c0f0fb0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:20.093735 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f3356c0a-d27d-4db7-b0d1-7e00c0f0fb0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:20.094490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f3356c0a-d27d-4db7-b0d1-7e00c0f0fb0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:20.098047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f3356c0a-d27d-4db7-b0d1-7e00c0f0fb0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:20.098782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f3356c0a-d27d-4db7-b0d1-7e00c0f0fb0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:20.345425 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-07e02170-9379-4cd5-b295-609e6e305c48 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 27379 microversion: 2.20 time: 0.336898 Apr 14 16:12:20.347430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 127/247] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:20 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 27379 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:20.550930 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f3356c0a-d27d-4db7-b0d1-7e00c0f0fb0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:20.561115 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f3356c0a-d27d-4db7-b0d1-7e00c0f0fb0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.493985 Apr 14 16:12:20.561115 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 121/248] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:20 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:20.760614 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e5b80cd2-b035-49b3-874b-fe95f95140a9 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:20.762130 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e5b80cd2-b035-49b3-874b-fe95f95140a9 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:20.791506 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e5b80cd2-b035-49b3-874b-fe95f95140a9 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:20.792586 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e5b80cd2-b035-49b3-874b-fe95f95140a9 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:20.794737 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e5b80cd2-b035-49b3-874b-fe95f95140a9 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:20.798544 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e5b80cd2-b035-49b3-874b-fe95f95140a9 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:21.083892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a8ece6e3-3917-482b-9294-b66fd72ebda1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:21.085914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a8ece6e3-3917-482b-9294-b66fd72ebda1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:21.108026 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a8ece6e3-3917-482b-9294-b66fd72ebda1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:21.128446 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a8ece6e3-3917-482b-9294-b66fd72ebda1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:21.129294 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a8ece6e3-3917-482b-9294-b66fd72ebda1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:21.135546 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a8ece6e3-3917-482b-9294-b66fd72ebda1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:21.156895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e5b80cd2-b035-49b3-874b-fe95f95140a9 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:21.167716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e5b80cd2-b035-49b3-874b-fe95f95140a9 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1317 microversion: 2.1 time: 0.422821 Apr 14 16:12:21.169195 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 128/249] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:20 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:21.359850 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1b21c0ab-1c09-403a-9689-7c9a624da835 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:21.360926 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1b21c0ab-1c09-403a-9689-7c9a624da835 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:21.374375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1b21c0ab-1c09-403a-9689-7c9a624da835 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:21.374888 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1b21c0ab-1c09-403a-9689-7c9a624da835 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:21.375779 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1b21c0ab-1c09-403a-9689-7c9a624da835 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:21.376290 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1b21c0ab-1c09-403a-9689-7c9a624da835 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:21.438607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a8ece6e3-3917-482b-9294-b66fd72ebda1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 23789 microversion: 2.1 time: 0.369208 Apr 14 16:12:21.439431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 122/250] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:21 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 23789 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:21.531164 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1b21c0ab-1c09-403a-9689-7c9a624da835 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 27757 microversion: 2.20 time: 0.176152 Apr 14 16:12:21.535638 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 129/251] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:21 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 27757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:21.584713 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cb2a4ae1-946c-44b7-a092-4026e30a7a3e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:21.586098 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cb2a4ae1-946c-44b7-a092-4026e30a7a3e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:21.606955 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cb2a4ae1-946c-44b7-a092-4026e30a7a3e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:21.607729 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cb2a4ae1-946c-44b7-a092-4026e30a7a3e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:21.608808 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cb2a4ae1-946c-44b7-a092-4026e30a7a3e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:21.613115 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cb2a4ae1-946c-44b7-a092-4026e30a7a3e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:21.673765 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-cbc361bb-7387-4dbe-8507-1c4651e7c987 req-9186bd55-6e3e-4988-9e59-6f6399023fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6b11f7-562d-499f-8db6-48e991d6802c", "tag": "74e72ff8-2061-4e4e-8b24-05f30e265a90"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:21.675681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:12:21.675681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:12:21.695054 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-cbc361bb-7387-4dbe-8507-1c4651e7c987 req-9186bd55-6e3e-4988-9e59-6f6399023fc2 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:21.695559 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-cbc361bb-7387-4dbe-8507-1c4651e7c987 req-9186bd55-6e3e-4988-9e59-6f6399023fc2 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:21.750137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-cbc361bb-7387-4dbe-8507-1c4651e7c987 req-9186bd55-6e3e-4988-9e59-6f6399023fc2 service nova] Creating event network-changed:74e72ff8-2061-4e4e-8b24-05f30e265a90 for instance fb6b11f7-562d-499f-8db6-48e991d6802c on hv-cinder-78626 Apr 14 16:12:21.759961 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-cbc361bb-7387-4dbe-8507-1c4651e7c987 req-9186bd55-6e3e-4988-9e59-6f6399023fc2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091665 Apr 14 16:12:21.767657 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 130/252] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:12:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:22.187015 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-da033670-d85c-4523-a7c6-5dea3a8bbe08 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:22.188059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-da033670-d85c-4523-a7c6-5dea3a8bbe08 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:22.214938 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da033670-d85c-4523-a7c6-5dea3a8bbe08 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:22.216243 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da033670-d85c-4523-a7c6-5dea3a8bbe08 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:22.217370 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da033670-d85c-4523-a7c6-5dea3a8bbe08 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:22.218045 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da033670-d85c-4523-a7c6-5dea3a8bbe08 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:22.344930 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cb2a4ae1-946c-44b7-a092-4026e30a7a3e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:22.369111 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cb2a4ae1-946c-44b7-a092-4026e30a7a3e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.790791 Apr 14 16:12:22.373528 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 123/253] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:21 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:22.451803 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-54f0f9fc-2c38-4154-872d-666b3e3f28c8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:22.453266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-54f0f9fc-2c38-4154-872d-666b3e3f28c8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:22.471147 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54f0f9fc-2c38-4154-872d-666b3e3f28c8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:22.472167 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54f0f9fc-2c38-4154-872d-666b3e3f28c8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:22.473274 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54f0f9fc-2c38-4154-872d-666b3e3f28c8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:22.474683 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54f0f9fc-2c38-4154-872d-666b3e3f28c8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:22.724757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-54f0f9fc-2c38-4154-872d-666b3e3f28c8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 24337 microversion: 2.1 time: 0.277517 Apr 14 16:12:22.725947 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 124/254] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:22 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 24337 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:12:22.731894 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-55872e15-7c01-4e89-a9a0-ed9f602b6a56 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:22.744969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-55872e15-7c01-4e89-a9a0-ed9f602b6a56 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:22.761235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-55872e15-7c01-4e89-a9a0-ed9f602b6a56 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:22.761762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-55872e15-7c01-4e89-a9a0-ed9f602b6a56 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:22.763585 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-55872e15-7c01-4e89-a9a0-ed9f602b6a56 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:22.765005 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-55872e15-7c01-4e89-a9a0-ed9f602b6a56 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:22.982591 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-55872e15-7c01-4e89-a9a0-ed9f602b6a56 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 27942 microversion: 2.20 time: 0.254705 Apr 14 16:12:22.983997 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 125/255] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:22 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 27942 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:23.191346 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-da033670-d85c-4523-a7c6-5dea3a8bbe08 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:23.202987 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-da033670-d85c-4523-a7c6-5dea3a8bbe08 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1317 microversion: 2.1 time: 1.020768 Apr 14 16:12:23.203625 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 131/256] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:22 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1317 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:23.393459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-dd095ba4-12bf-4412-a039-2d5a6dffda5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:23.394246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-dd095ba4-12bf-4412-a039-2d5a6dffda5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:23.429903 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dd095ba4-12bf-4412-a039-2d5a6dffda5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:23.430505 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dd095ba4-12bf-4412-a039-2d5a6dffda5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:23.431657 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dd095ba4-12bf-4412-a039-2d5a6dffda5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:23.432165 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dd095ba4-12bf-4412-a039-2d5a6dffda5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:23.737927 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a1557b03-9d3f-4831-a9f0-1053040777fa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:23.738969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a1557b03-9d3f-4831-a9f0-1053040777fa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:23.759239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a1557b03-9d3f-4831-a9f0-1053040777fa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:23.764254 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a1557b03-9d3f-4831-a9f0-1053040777fa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:23.770406 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a1557b03-9d3f-4831-a9f0-1053040777fa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:23.771303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a1557b03-9d3f-4831-a9f0-1053040777fa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:23.937311 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a1557b03-9d3f-4831-a9f0-1053040777fa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 24920 microversion: 2.1 time: 0.203294 Apr 14 16:12:23.941740 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 132/257] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:23 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 24920 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:23.941923 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-dd095ba4-12bf-4412-a039-2d5a6dffda5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:23.953495 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-dd095ba4-12bf-4412-a039-2d5a6dffda5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.566604 Apr 14 16:12:23.963389 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 126/258] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:23 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:23.996352 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f8491fdd-9a05-4021-a810-97446a6be90c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:23.997791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f8491fdd-9a05-4021-a810-97446a6be90c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:24.008739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f8491fdd-9a05-4021-a810-97446a6be90c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:24.009309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f8491fdd-9a05-4021-a810-97446a6be90c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:24.010163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f8491fdd-9a05-4021-a810-97446a6be90c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:24.010634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f8491fdd-9a05-4021-a810-97446a6be90c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:24.220764 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-08677401-213c-4f46-90a7-99432698e9db tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:24.221697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-08677401-213c-4f46-90a7-99432698e9db tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:24.239821 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-08677401-213c-4f46-90a7-99432698e9db tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:24.240367 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-08677401-213c-4f46-90a7-99432698e9db tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:24.241378 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-08677401-213c-4f46-90a7-99432698e9db tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:24.241887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-08677401-213c-4f46-90a7-99432698e9db tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:24.314921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f8491fdd-9a05-4021-a810-97446a6be90c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28111 microversion: 2.20 time: 0.323350 Apr 14 16:12:24.316408 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 133/259] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:23 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28111 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:24.695610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-08677401-213c-4f46-90a7-99432698e9db tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:24.705971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-08677401-213c-4f46-90a7-99432698e9db tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1317 microversion: 2.1 time: 0.489753 Apr 14 16:12:24.708837 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 127/260] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:24 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:24.952408 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-503ce5c9-e478-4a3f-951e-0cd233a57e81 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:24.953697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-503ce5c9-e478-4a3f-951e-0cd233a57e81 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:24.971811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a929a23b-566a-4209-81c7-694f5771966f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:24.972495 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a929a23b-566a-4209-81c7-694f5771966f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:24.973909 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-503ce5c9-e478-4a3f-951e-0cd233a57e81 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:24.974418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-503ce5c9-e478-4a3f-951e-0cd233a57e81 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:24.975271 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-503ce5c9-e478-4a3f-951e-0cd233a57e81 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:24.975737 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-503ce5c9-e478-4a3f-951e-0cd233a57e81 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:24.986066 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a929a23b-566a-4209-81c7-694f5771966f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:24.994644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a929a23b-566a-4209-81c7-694f5771966f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:24.995669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a929a23b-566a-4209-81c7-694f5771966f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:24.996189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a929a23b-566a-4209-81c7-694f5771966f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:25.200931 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-503ce5c9-e478-4a3f-951e-0cd233a57e81 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 25631 microversion: 2.1 time: 0.254232 Apr 14 16:12:25.201358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 134/261] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:24 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 25631 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:25.328251 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-04e792fb-10ca-4bfb-a17b-0b8cc3ba57cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:25.329392 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-04e792fb-10ca-4bfb-a17b-0b8cc3ba57cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:25.338140 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-04e792fb-10ca-4bfb-a17b-0b8cc3ba57cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:25.338885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-04e792fb-10ca-4bfb-a17b-0b8cc3ba57cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:25.339918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-04e792fb-10ca-4bfb-a17b-0b8cc3ba57cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:25.341200 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-04e792fb-10ca-4bfb-a17b-0b8cc3ba57cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:25.359885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a929a23b-566a-4209-81c7-694f5771966f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:25.370438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a929a23b-566a-4209-81c7-694f5771966f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.402717 Apr 14 16:12:25.380898 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 128/262] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:24 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:25.502241 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-04e792fb-10ca-4bfb-a17b-0b8cc3ba57cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28233 microversion: 2.20 time: 0.178218 Apr 14 16:12:25.506610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 135/263] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:25 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28233 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:12:25.724070 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-62adec72-5b81-48d4-a926-0cb5ab85f07d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:25.724744 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-62adec72-5b81-48d4-a926-0cb5ab85f07d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:25.735449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-62adec72-5b81-48d4-a926-0cb5ab85f07d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:25.735875 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-62adec72-5b81-48d4-a926-0cb5ab85f07d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:25.737120 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-62adec72-5b81-48d4-a926-0cb5ab85f07d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:25.737634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-62adec72-5b81-48d4-a926-0cb5ab85f07d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:25.981289 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-62adec72-5b81-48d4-a926-0cb5ab85f07d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:25.987415 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-62adec72-5b81-48d4-a926-0cb5ab85f07d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1317 microversion: 2.1 time: 0.267263 Apr 14 16:12:25.988667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 129/264] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:25 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:26.212919 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-38a3d683-b249-441e-ab12-230ebddea12a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:26.214111 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-38a3d683-b249-441e-ab12-230ebddea12a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:26.223391 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-38a3d683-b249-441e-ab12-230ebddea12a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:26.224123 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-38a3d683-b249-441e-ab12-230ebddea12a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:26.225195 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-38a3d683-b249-441e-ab12-230ebddea12a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:26.225895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-38a3d683-b249-441e-ab12-230ebddea12a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:26.388589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-38a3d683-b249-441e-ab12-230ebddea12a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 26126 microversion: 2.1 time: 0.179035 Apr 14 16:12:26.390386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4ce16052-713f-49fa-96cd-b7e5a4971c0e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:26.391147 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4ce16052-713f-49fa-96cd-b7e5a4971c0e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:26.395219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 136/265] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:26 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 26126 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:26.400100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4ce16052-713f-49fa-96cd-b7e5a4971c0e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:26.400712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4ce16052-713f-49fa-96cd-b7e5a4971c0e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:26.401840 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4ce16052-713f-49fa-96cd-b7e5a4971c0e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:26.402420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4ce16052-713f-49fa-96cd-b7e5a4971c0e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:26.516209 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6eeae6a6-fcd5-4129-bebf-9a301d638372 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:26.517684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6eeae6a6-fcd5-4129-bebf-9a301d638372 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:26.531948 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6eeae6a6-fcd5-4129-bebf-9a301d638372 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:26.533127 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6eeae6a6-fcd5-4129-bebf-9a301d638372 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:26.536736 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6eeae6a6-fcd5-4129-bebf-9a301d638372 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:26.537553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6eeae6a6-fcd5-4129-bebf-9a301d638372 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:26.633605 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4ce16052-713f-49fa-96cd-b7e5a4971c0e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:26.643937 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4ce16052-713f-49fa-96cd-b7e5a4971c0e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.259232 Apr 14 16:12:26.645053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 130/266] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:26 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:26.716908 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6eeae6a6-fcd5-4129-bebf-9a301d638372 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28391 microversion: 2.20 time: 0.205721 Apr 14 16:12:26.720778 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 137/267] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:26 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28391 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:27.006954 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-85cc8f9b-36d3-4c4e-abaa-973cf252e9c4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:27.008052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-85cc8f9b-36d3-4c4e-abaa-973cf252e9c4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:27.023573 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85cc8f9b-36d3-4c4e-abaa-973cf252e9c4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:27.025073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85cc8f9b-36d3-4c4e-abaa-973cf252e9c4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:27.028720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85cc8f9b-36d3-4c4e-abaa-973cf252e9c4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:27.029732 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85cc8f9b-36d3-4c4e-abaa-973cf252e9c4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:27.405202 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-954cfac9-1703-4d86-bd4b-1468426a6554 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:27.406449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-954cfac9-1703-4d86-bd4b-1468426a6554 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:27.415697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-954cfac9-1703-4d86-bd4b-1468426a6554 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:27.416536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-954cfac9-1703-4d86-bd4b-1468426a6554 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:27.417620 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-954cfac9-1703-4d86-bd4b-1468426a6554 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:27.418440 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-954cfac9-1703-4d86-bd4b-1468426a6554 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:27.421411 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-85cc8f9b-36d3-4c4e-abaa-973cf252e9c4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:27.433126 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-85cc8f9b-36d3-4c4e-abaa-973cf252e9c4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1317 microversion: 2.1 time: 0.430784 Apr 14 16:12:27.435037 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 131/268] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:27 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:27.581738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-954cfac9-1703-4d86-bd4b-1468426a6554 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 26523 microversion: 2.1 time: 0.181892 Apr 14 16:12:27.583026 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 138/269] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:27 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 26523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:27.664028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-76cb23d1-327c-4c8f-bfb7-c9d03537ae6f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:27.664702 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-76cb23d1-327c-4c8f-bfb7-c9d03537ae6f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:27.676298 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-76cb23d1-327c-4c8f-bfb7-c9d03537ae6f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:27.676877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-76cb23d1-327c-4c8f-bfb7-c9d03537ae6f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:27.677711 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-76cb23d1-327c-4c8f-bfb7-c9d03537ae6f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:27.678213 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-76cb23d1-327c-4c8f-bfb7-c9d03537ae6f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:27.731104 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bce5011d-f0ca-4fb5-81c5-bce21ca57ba7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:27.732240 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bce5011d-f0ca-4fb5-81c5-bce21ca57ba7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:27.751695 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bce5011d-f0ca-4fb5-81c5-bce21ca57ba7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:27.752200 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bce5011d-f0ca-4fb5-81c5-bce21ca57ba7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:27.753070 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bce5011d-f0ca-4fb5-81c5-bce21ca57ba7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:27.753569 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bce5011d-f0ca-4fb5-81c5-bce21ca57ba7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:27.902888 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-76cb23d1-327c-4c8f-bfb7-c9d03537ae6f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:27.912561 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-76cb23d1-327c-4c8f-bfb7-c9d03537ae6f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.252681 Apr 14 16:12:27.913563 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 132/270] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:27 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:27.932789 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bce5011d-f0ca-4fb5-81c5-bce21ca57ba7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28417 microversion: 2.20 time: 0.207003 Apr 14 16:12:27.934272 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 139/271] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:27 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28417 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:12:28.452816 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5514bb07-45e4-41f2-a3d1-86940fe6abdb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:28.454200 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5514bb07-45e4-41f2-a3d1-86940fe6abdb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:28.462741 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5514bb07-45e4-41f2-a3d1-86940fe6abdb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:28.463455 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5514bb07-45e4-41f2-a3d1-86940fe6abdb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:28.464572 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5514bb07-45e4-41f2-a3d1-86940fe6abdb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:28.465305 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5514bb07-45e4-41f2-a3d1-86940fe6abdb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:28.599771 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a0c56171-c746-457c-acd5-d9edc490fb1d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:28.601132 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a0c56171-c746-457c-acd5-d9edc490fb1d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:28.617471 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0c56171-c746-457c-acd5-d9edc490fb1d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:28.617977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0c56171-c746-457c-acd5-d9edc490fb1d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:28.618815 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0c56171-c746-457c-acd5-d9edc490fb1d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:28.619298 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0c56171-c746-457c-acd5-d9edc490fb1d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:28.756825 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5514bb07-45e4-41f2-a3d1-86940fe6abdb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:28.766043 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5514bb07-45e4-41f2-a3d1-86940fe6abdb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1317 microversion: 2.1 time: 0.318048 Apr 14 16:12:28.766883 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 133/272] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:28 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:28.781947 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a0c56171-c746-457c-acd5-d9edc490fb1d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 27000 microversion: 2.1 time: 0.191580 Apr 14 16:12:28.786399 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 140/273] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:28 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 27000 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:28.934727 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-77632122-c47e-4a24-9cb2-45d620014439 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:28.935845 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-77632122-c47e-4a24-9cb2-45d620014439 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:28.951050 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f21a5ddb-33b5-4f6c-afa1-552c3dbae7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:28.952763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f21a5ddb-33b5-4f6c-afa1-552c3dbae7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:28.977022 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-77632122-c47e-4a24-9cb2-45d620014439 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:28.981612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-77632122-c47e-4a24-9cb2-45d620014439 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:28.991459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-77632122-c47e-4a24-9cb2-45d620014439 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:28.993606 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-77632122-c47e-4a24-9cb2-45d620014439 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:29.015866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f21a5ddb-33b5-4f6c-afa1-552c3dbae7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:29.020984 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f21a5ddb-33b5-4f6c-afa1-552c3dbae7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:29.023371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f21a5ddb-33b5-4f6c-afa1-552c3dbae7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:29.024127 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f21a5ddb-33b5-4f6c-afa1-552c3dbae7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:29.184661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f21a5ddb-33b5-4f6c-afa1-552c3dbae7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28417 microversion: 2.20 time: 0.241530 Apr 14 16:12:29.186221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 141/274] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:28 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28417 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:29.282426 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-77632122-c47e-4a24-9cb2-45d620014439 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:29.295183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-77632122-c47e-4a24-9cb2-45d620014439 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.365542 Apr 14 16:12:29.296009 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 134/275] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:28 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:29.785731 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cd98f5db-4d9a-4e21-81cf-52b420a119b7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:29.786505 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cd98f5db-4d9a-4e21-81cf-52b420a119b7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:29.795790 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-140842aa-53ea-4015-8126-d5c44abb8702 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:29.796220 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd98f5db-4d9a-4e21-81cf-52b420a119b7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:29.796735 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd98f5db-4d9a-4e21-81cf-52b420a119b7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:29.796928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-140842aa-53ea-4015-8126-d5c44abb8702 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:29.797617 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd98f5db-4d9a-4e21-81cf-52b420a119b7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:29.798093 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd98f5db-4d9a-4e21-81cf-52b420a119b7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:29.805117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-140842aa-53ea-4015-8126-d5c44abb8702 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:29.805630 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-140842aa-53ea-4015-8126-d5c44abb8702 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:29.807095 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-140842aa-53ea-4015-8126-d5c44abb8702 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:29.807229 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-140842aa-53ea-4015-8126-d5c44abb8702 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:29.931211 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-140842aa-53ea-4015-8126-d5c44abb8702 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 27413 microversion: 2.1 time: 0.140044 Apr 14 16:12:29.932547 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 135/276] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:29 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 27413 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:12:29.938253 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5849a4c4-cbe6-49f2-b59e-802ecced4792 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Action: 'create', calling method: .version_select at 0x7ff58cc46950>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-106284262"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:29.963144 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-5849a4c4-cbe6-49f2-b59e-802ecced4792 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Getting quotas for project 8e71c42092894db98f8db75a2719f751. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:12:29.968231 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-5849a4c4-cbe6-49f2-b59e-802ecced4792 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Getting quotas for user 0b308998794d4586b99c9d8eb562751e and project 8e71c42092894db98f8db75a2719f751. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:12:30.012810 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cd98f5db-4d9a-4e21-81cf-52b420a119b7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:30.023397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cd98f5db-4d9a-4e21-81cf-52b420a119b7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1317 microversion: 2.1 time: 0.242100 Apr 14 16:12:30.024100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 142/277] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:29 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:30.197507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0af54c92-ac50-4132-a243-1b1b8c89e797 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:30.198786 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0af54c92-ac50-4132-a243-1b1b8c89e797 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:30.203837 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-5849a4c4-cbe6-49f2-b59e-802ecced4792 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Getting quotas for project 8e71c42092894db98f8db75a2719f751. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:12:30.208605 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-5849a4c4-cbe6-49f2-b59e-802ecced4792 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Getting quotas for user 0b308998794d4586b99c9d8eb562751e and project 8e71c42092894db98f8db75a2719f751. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:12:30.215886 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0af54c92-ac50-4132-a243-1b1b8c89e797 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:30.221990 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0af54c92-ac50-4132-a243-1b1b8c89e797 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:30.223245 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5849a4c4-cbe6-49f2-b59e-802ecced4792 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.289808 Apr 14 16:12:30.223514 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0af54c92-ac50-4132-a243-1b1b8c89e797 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:30.224144 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0af54c92-ac50-4132-a243-1b1b8c89e797 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:30.224556 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 136/278] 10.222.0.60 () {60 vars in 1148 bytes} [Wed Apr 14 16:12:29 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:30.317736 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-31928527-156f-441c-bc95-a1d004a582c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:30.318967 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-31928527-156f-441c-bc95-a1d004a582c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:30.334035 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-31928527-156f-441c-bc95-a1d004a582c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:30.345875 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-31928527-156f-441c-bc95-a1d004a582c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:30.347110 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-31928527-156f-441c-bc95-a1d004a582c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:30.347772 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-31928527-156f-441c-bc95-a1d004a582c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:30.545285 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0af54c92-ac50-4132-a243-1b1b8c89e797 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28417 microversion: 2.20 time: 0.351653 Apr 14 16:12:30.546080 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 143/279] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:30 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28417 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:30.552273 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1726593155", "imageRef": "aa5db511-a4a2-4b8c-bbed-3b57217df487", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-106284262", "networks": [{"uuid": "78e99240-3773-4c32-b324-b8b4ec7c5482"}]}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:30.575844 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-31928527-156f-441c-bc95-a1d004a582c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:30.585689 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-31928527-156f-441c-bc95-a1d004a582c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.271844 Apr 14 16:12:30.586222 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 137/280] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:30 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:30.630810 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] validate_networks() for [('78e99240-3773-4c32-b324-b8b4ec7c5482', None, None, None)] {{(pid=99334) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:12:30.944817 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5420b9c1-e96b-44a4-8560-38ed9ff10e8a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:30.946153 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5420b9c1-e96b-44a4-8560-38ed9ff10e8a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:30.955153 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5420b9c1-e96b-44a4-8560-38ed9ff10e8a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:30.955847 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5420b9c1-e96b-44a4-8560-38ed9ff10e8a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:30.956829 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5420b9c1-e96b-44a4-8560-38ed9ff10e8a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:30.957503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5420b9c1-e96b-44a4-8560-38ed9ff10e8a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:31.109004 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5420b9c1-e96b-44a4-8560-38ed9ff10e8a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 27818 microversion: 2.1 time: 0.168513 Apr 14 16:12:31.113528 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 138/281] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:30 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 27818 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:12:31.116974 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ef5276bb-f5d0-47de-9a47-173db4c996ee tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:31.117853 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ef5276bb-f5d0-47de-9a47-173db4c996ee tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:31.136210 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ef5276bb-f5d0-47de-9a47-173db4c996ee tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:31.137123 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ef5276bb-f5d0-47de-9a47-173db4c996ee tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:31.138175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ef5276bb-f5d0-47de-9a47-173db4c996ee tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:31.138675 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ef5276bb-f5d0-47de-9a47-173db4c996ee tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:31.353790 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Flavor limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:12:31.354375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Image limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:12:31.354627 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ef5276bb-f5d0-47de-9a47-173db4c996ee tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:31.355105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Flavor pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:12:31.355655 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Image pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:12:31.356676 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:12:31.365661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ef5276bb-f5d0-47de-9a47-173db4c996ee tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1317 microversion: 2.1 time: 0.254422 Apr 14 16:12:31.366646 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 139/282] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:31 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:31.370289 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:31.371244 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:31.372362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:31.373108 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:31.393346 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Getting quotas for project 8e71c42092894db98f8db75a2719f751. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:12:31.397832 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Getting quotas for user 0b308998794d4586b99c9d8eb562751e and project 8e71c42092894db98f8db75a2719f751. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:12:31.409659 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Going to run 1 instances... {{(pid=99334) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:12:31.412475 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa5db511-a4a2-4b8c-bbed-3b57217df487',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:12:31.464536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-70a7c9fd-536c-4254-bc4c-e9e7d1803c86 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.916974 Apr 14 16:12:31.466487 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 144/283] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:12:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:12:31.477009 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4617283f-1d89-48d2-ac01-ca027f41163d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:31.477565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4617283f-1d89-48d2-ac01-ca027f41163d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:31.558800 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2518baac-7d1c-4871-8837-b5e6ab92835e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:31.560838 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2518baac-7d1c-4871-8837-b5e6ab92835e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:31.570548 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2518baac-7d1c-4871-8837-b5e6ab92835e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:31.570986 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2518baac-7d1c-4871-8837-b5e6ab92835e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:31.571837 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2518baac-7d1c-4871-8837-b5e6ab92835e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:31.572334 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2518baac-7d1c-4871-8837-b5e6ab92835e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:31.588502 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4617283f-1d89-48d2-ac01-ca027f41163d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:31.599443 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4617283f-1d89-48d2-ac01-ca027f41163d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1258 microversion: 2.1 time: 0.126396 Apr 14 16:12:31.600940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 140/284] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:31 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1258 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:31.607693 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d72f6033-3109-4a31-a76e-3790156a24d5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:31.609871 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d72f6033-3109-4a31-a76e-3790156a24d5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:31.620360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d72f6033-3109-4a31-a76e-3790156a24d5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:31.620990 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d72f6033-3109-4a31-a76e-3790156a24d5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:31.622813 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d72f6033-3109-4a31-a76e-3790156a24d5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:31.623273 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d72f6033-3109-4a31-a76e-3790156a24d5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:31.737792 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2518baac-7d1c-4871-8837-b5e6ab92835e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28417 microversion: 2.20 time: 0.183511 Apr 14 16:12:31.738274 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 145/285] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:31 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28417 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:12:31.837493 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d72f6033-3109-4a31-a76e-3790156a24d5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:31.847213 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d72f6033-3109-4a31-a76e-3790156a24d5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.244885 Apr 14 16:12:31.848246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 141/286] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:31 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:32.124499 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b429901d-f7ef-40b2-a9be-29781f0bedc3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:32.126538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b429901d-f7ef-40b2-a9be-29781f0bedc3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:32.144805 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b429901d-f7ef-40b2-a9be-29781f0bedc3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:32.145625 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b429901d-f7ef-40b2-a9be-29781f0bedc3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:32.146486 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b429901d-f7ef-40b2-a9be-29781f0bedc3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:32.146977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b429901d-f7ef-40b2-a9be-29781f0bedc3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:32.313086 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b429901d-f7ef-40b2-a9be-29781f0bedc3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 28033 microversion: 2.1 time: 0.195009 Apr 14 16:12:32.317200 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 146/287] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:32 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 28033 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:32.384093 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-06a5f292-077b-4dbb-a87e-33be0f955616 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:32.384765 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-06a5f292-077b-4dbb-a87e-33be0f955616 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:32.393740 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06a5f292-077b-4dbb-a87e-33be0f955616 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:32.394254 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06a5f292-077b-4dbb-a87e-33be0f955616 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:32.395110 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06a5f292-077b-4dbb-a87e-33be0f955616 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:32.395609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06a5f292-077b-4dbb-a87e-33be0f955616 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:32.619724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f72c0a5f-004c-4564-86af-b49bdbf12373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:32.620598 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f72c0a5f-004c-4564-86af-b49bdbf12373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:32.630757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f72c0a5f-004c-4564-86af-b49bdbf12373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:32.631609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f72c0a5f-004c-4564-86af-b49bdbf12373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:32.632707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f72c0a5f-004c-4564-86af-b49bdbf12373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:32.633341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f72c0a5f-004c-4564-86af-b49bdbf12373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:32.706287 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-06a5f292-077b-4dbb-a87e-33be0f955616 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:32.737296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-06a5f292-077b-4dbb-a87e-33be0f955616 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1317 microversion: 2.1 time: 0.344414 Apr 14 16:12:32.739038 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 142/288] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:32 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:32.755723 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-47150016-949d-4410-bdf7-c24bc442afee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:32.755723 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-47150016-949d-4410-bdf7-c24bc442afee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:32.760101 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-47150016-949d-4410-bdf7-c24bc442afee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:32.760592 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-47150016-949d-4410-bdf7-c24bc442afee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:32.761873 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-47150016-949d-4410-bdf7-c24bc442afee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:32.762608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-47150016-949d-4410-bdf7-c24bc442afee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:32.806136 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f72c0a5f-004c-4564-86af-b49bdbf12373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:32.816366 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f72c0a5f-004c-4564-86af-b49bdbf12373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1310 microversion: 2.1 time: 0.201506 Apr 14 16:12:32.825181 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 147/289] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:32 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1310 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:32.865969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-922b063a-6779-4866-9441-5c7bfdbf2d3d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:32.866749 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-922b063a-6779-4866-9441-5c7bfdbf2d3d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:32.876643 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-922b063a-6779-4866-9441-5c7bfdbf2d3d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:32.876643 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-922b063a-6779-4866-9441-5c7bfdbf2d3d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:32.876643 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-922b063a-6779-4866-9441-5c7bfdbf2d3d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:32.877068 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-922b063a-6779-4866-9441-5c7bfdbf2d3d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:32.927310 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-47150016-949d-4410-bdf7-c24bc442afee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28417 microversion: 2.20 time: 0.180996 Apr 14 16:12:32.928980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 143/290] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:32 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28417 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:12:33.113207 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-922b063a-6779-4866-9441-5c7bfdbf2d3d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:33.124509 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-922b063a-6779-4866-9441-5c7bfdbf2d3d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.262682 Apr 14 16:12:33.126183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 148/291] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:32 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:12:33.326359 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b292695a-6804-42e1-975a-cb283a1f2b96 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:33.327564 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b292695a-6804-42e1-975a-cb283a1f2b96 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:33.341565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b292695a-6804-42e1-975a-cb283a1f2b96 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:33.342089 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b292695a-6804-42e1-975a-cb283a1f2b96 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:33.342968 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b292695a-6804-42e1-975a-cb283a1f2b96 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:33.343473 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b292695a-6804-42e1-975a-cb283a1f2b96 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:33.469410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-3197945a-a975-444a-8699-da7b46ecd707 req-3879b539-45cd-46be-a86e-b2f9f79f833b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6b11f7-562d-499f-8db6-48e991d6802c", "name": "network-vif-plugged", "status": "completed", "tag": "74e72ff8-2061-4e4e-8b24-05f30e265a90"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:33.475146 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:12:33.475146 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:12:33.484494 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b292695a-6804-42e1-975a-cb283a1f2b96 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 28213 microversion: 2.1 time: 0.162750 Apr 14 16:12:33.485453 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 144/292] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:33 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 28213 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:33.511009 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-3197945a-a975-444a-8699-da7b46ecd707 req-3879b539-45cd-46be-a86e-b2f9f79f833b service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:33.514141 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-3197945a-a975-444a-8699-da7b46ecd707 req-3879b539-45cd-46be-a86e-b2f9f79f833b service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:33.554213 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-3197945a-a975-444a-8699-da7b46ecd707 req-3879b539-45cd-46be-a86e-b2f9f79f833b service nova] Creating event network-vif-plugged:74e72ff8-2061-4e4e-8b24-05f30e265a90 for instance fb6b11f7-562d-499f-8db6-48e991d6802c on hv-cinder-78626 Apr 14 16:12:33.567827 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-3197945a-a975-444a-8699-da7b46ecd707 req-3879b539-45cd-46be-a86e-b2f9f79f833b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108923 Apr 14 16:12:33.571441 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 149/293] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:12:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:12:33.758302 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d457a655-f43c-4a4d-a197-a7d628287992 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:33.761390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d457a655-f43c-4a4d-a197-a7d628287992 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:33.783680 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d457a655-f43c-4a4d-a197-a7d628287992 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:33.789854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d457a655-f43c-4a4d-a197-a7d628287992 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:33.790776 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d457a655-f43c-4a4d-a197-a7d628287992 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:33.791276 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d457a655-f43c-4a4d-a197-a7d628287992 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:33.839221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6c68e534-943f-4b37-9002-5a04e16c29a7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:33.840006 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6c68e534-943f-4b37-9002-5a04e16c29a7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:33.861511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6c68e534-943f-4b37-9002-5a04e16c29a7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:33.861944 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6c68e534-943f-4b37-9002-5a04e16c29a7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:33.862811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6c68e534-943f-4b37-9002-5a04e16c29a7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:33.863418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6c68e534-943f-4b37-9002-5a04e16c29a7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:34.114224 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6c68e534-943f-4b37-9002-5a04e16c29a7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:34.145609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6c68e534-943f-4b37-9002-5a04e16c29a7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1316 microversion: 2.1 time: 0.311684 Apr 14 16:12:34.146922 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 150/294] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:33 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:34.164327 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9c815aec-99da-4444-a5a0-42a016e83a9a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:34.166367 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9c815aec-99da-4444-a5a0-42a016e83a9a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:34.201495 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c815aec-99da-4444-a5a0-42a016e83a9a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:34.205052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c815aec-99da-4444-a5a0-42a016e83a9a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:34.209253 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c815aec-99da-4444-a5a0-42a016e83a9a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:34.215075 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c815aec-99da-4444-a5a0-42a016e83a9a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:34.350278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d457a655-f43c-4a4d-a197-a7d628287992 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:34.363941 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d457a655-f43c-4a4d-a197-a7d628287992 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1317 microversion: 2.1 time: 0.608802 Apr 14 16:12:34.368348 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 145/295] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:33 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1317 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:34.378846 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f35649f3-1efc-4616-8e2a-b9b8d9899c2f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:34.383487 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f35649f3-1efc-4616-8e2a-b9b8d9899c2f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:34.402508 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f35649f3-1efc-4616-8e2a-b9b8d9899c2f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:34.403379 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f35649f3-1efc-4616-8e2a-b9b8d9899c2f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:34.404403 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f35649f3-1efc-4616-8e2a-b9b8d9899c2f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:34.406309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f35649f3-1efc-4616-8e2a-b9b8d9899c2f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:34.923085 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f35649f3-1efc-4616-8e2a-b9b8d9899c2f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:34.935908 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f35649f3-1efc-4616-8e2a-b9b8d9899c2f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.565351 Apr 14 16:12:34.936541 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 146/296] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:34 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:34.944162 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3e015b07-8b56-417a-b1e2-98588aa75653 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:34.952031 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3e015b07-8b56-417a-b1e2-98588aa75653 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:34.968819 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e015b07-8b56-417a-b1e2-98588aa75653 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:34.969603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e015b07-8b56-417a-b1e2-98588aa75653 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:34.970652 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e015b07-8b56-417a-b1e2-98588aa75653 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:34.971325 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e015b07-8b56-417a-b1e2-98588aa75653 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:51.646113 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9c815aec-99da-4444-a5a0-42a016e83a9a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28873 microversion: 2.20 time: 17.495652 Apr 14 16:12:51.646950 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 151/297] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:34 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28873 bytes in 17498 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:51.656462 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3e015b07-8b56-417a-b1e2-98588aa75653 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 28396 microversion: 2.1 time: 16.717914 Apr 14 16:12:51.662351 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 147/298] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:34 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 28396 bytes in 16725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:51.668499 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-19716464-6c20-4531-ac60-e254f1170730 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:51.671210 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e46e84bc-2186-4ec1-ba3b-090bab82c9f5 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:51.672914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-19716464-6c20-4531-ac60-e254f1170730 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:51.673351 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e46e84bc-2186-4ec1-ba3b-090bab82c9f5 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:51.692008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e46e84bc-2186-4ec1-ba3b-090bab82c9f5 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:51.693654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19716464-6c20-4531-ac60-e254f1170730 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:51.694404 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e46e84bc-2186-4ec1-ba3b-090bab82c9f5 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:51.695362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19716464-6c20-4531-ac60-e254f1170730 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:51.696453 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e46e84bc-2186-4ec1-ba3b-090bab82c9f5 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:51.697585 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19716464-6c20-4531-ac60-e254f1170730 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:51.698288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e46e84bc-2186-4ec1-ba3b-090bab82c9f5 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:51.698993 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19716464-6c20-4531-ac60-e254f1170730 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:52.047233 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e46e84bc-2186-4ec1-ba3b-090bab82c9f5 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:52.064651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e46e84bc-2186-4ec1-ba3b-090bab82c9f5 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1358 microversion: 2.1 time: 0.416159 Apr 14 16:12:52.065434 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 152/299] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:51 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1358 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:52.081379 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b5923091-71ea-4f9c-9a29-95a1b3a2128b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:52.082042 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b5923091-71ea-4f9c-9a29-95a1b3a2128b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:52.091588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5923091-71ea-4f9c-9a29-95a1b3a2128b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:52.092170 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5923091-71ea-4f9c-9a29-95a1b3a2128b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:52.093028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5923091-71ea-4f9c-9a29-95a1b3a2128b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:52.093543 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5923091-71ea-4f9c-9a29-95a1b3a2128b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:52.257136 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-19716464-6c20-4531-ac60-e254f1170730 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:52.267576 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-19716464-6c20-4531-ac60-e254f1170730 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1317 microversion: 2.1 time: 0.603657 Apr 14 16:12:52.268693 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 148/300] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:51 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1317 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:52.493200 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b5923091-71ea-4f9c-9a29-95a1b3a2128b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:52.503172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b5923091-71ea-4f9c-9a29-95a1b3a2128b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.425618 Apr 14 16:12:52.512849 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 153/301] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:52 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:52.660099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-29cb9be9-3151-4cce-8d94-f7a5fa0a71d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:52.661328 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-29cb9be9-3151-4cce-8d94-f7a5fa0a71d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:52.671027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cbb90d17-70b0-456d-b6e8-fd3c1773c2e1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:52.672065 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cbb90d17-70b0-456d-b6e8-fd3c1773c2e1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:52.676522 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29cb9be9-3151-4cce-8d94-f7a5fa0a71d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:52.679238 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29cb9be9-3151-4cce-8d94-f7a5fa0a71d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:52.680250 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29cb9be9-3151-4cce-8d94-f7a5fa0a71d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:52.686670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29cb9be9-3151-4cce-8d94-f7a5fa0a71d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:52.696385 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbb90d17-70b0-456d-b6e8-fd3c1773c2e1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:52.701466 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbb90d17-70b0-456d-b6e8-fd3c1773c2e1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:52.702735 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbb90d17-70b0-456d-b6e8-fd3c1773c2e1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:52.705586 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbb90d17-70b0-456d-b6e8-fd3c1773c2e1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:52.928517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-29cb9be9-3151-4cce-8d94-f7a5fa0a71d5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28873 microversion: 2.20 time: 0.273027 Apr 14 16:12:52.929858 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 149/302] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:52 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28873 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:52.945618 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cbb90d17-70b0-456d-b6e8-fd3c1773c2e1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 28396 microversion: 2.1 time: 0.279420 Apr 14 16:12:52.946328 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 154/303] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:52 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 28396 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:53.085144 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-00f97216-bd94-45fa-a9f9-e46fa824a5d0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:53.086178 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-00f97216-bd94-45fa-a9f9-e46fa824a5d0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:53.112470 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00f97216-bd94-45fa-a9f9-e46fa824a5d0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:53.113257 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00f97216-bd94-45fa-a9f9-e46fa824a5d0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:53.117967 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00f97216-bd94-45fa-a9f9-e46fa824a5d0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:53.118631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00f97216-bd94-45fa-a9f9-e46fa824a5d0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:53.287702 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-903e5a0d-2197-4395-bc14-cf1f07781dca tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:53.288762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-903e5a0d-2197-4395-bc14-cf1f07781dca tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:53.305620 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-903e5a0d-2197-4395-bc14-cf1f07781dca tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:53.306125 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-903e5a0d-2197-4395-bc14-cf1f07781dca tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:53.306990 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-903e5a0d-2197-4395-bc14-cf1f07781dca tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:53.307483 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-903e5a0d-2197-4395-bc14-cf1f07781dca tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:53.634340 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-00f97216-bd94-45fa-a9f9-e46fa824a5d0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:53.650154 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-00f97216-bd94-45fa-a9f9-e46fa824a5d0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1358 microversion: 2.1 time: 0.569320 Apr 14 16:12:53.651009 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 150/304] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:53 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1358 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:53.666681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-ebf42fc5-fc75-430f-8936-424472313c8e req-a1a81de3-ea08-4da0-b4b8-d1d908643d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93346a14-b6f5-4d77-a1a7-f4d649c7ccd5", "tag": "3a58c362-2e99-4559-9977-3b635ab88161"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:53.668625 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:12:53.668625 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:12:53.677959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-ebf42fc5-fc75-430f-8936-424472313c8e req-a1a81de3-ea08-4da0-b4b8-d1d908643d91 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:53.678402 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-ebf42fc5-fc75-430f-8936-424472313c8e req-a1a81de3-ea08-4da0-b4b8-d1d908643d91 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:53.682139 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-903e5a0d-2197-4395-bc14-cf1f07781dca tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:53.692237 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-903e5a0d-2197-4395-bc14-cf1f07781dca tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1317 microversion: 2.1 time: 0.409195 Apr 14 16:12:53.696306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 155/305] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:53 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:53.697905 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a111a0f7-be6a-4aaf-b52b-de637b7a7fc2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:53.698581 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a111a0f7-be6a-4aaf-b52b-de637b7a7fc2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:53.707460 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a111a0f7-be6a-4aaf-b52b-de637b7a7fc2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:53.707864 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a111a0f7-be6a-4aaf-b52b-de637b7a7fc2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:53.708688 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a111a0f7-be6a-4aaf-b52b-de637b7a7fc2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:53.709448 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a111a0f7-be6a-4aaf-b52b-de637b7a7fc2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:53.712857 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-ebf42fc5-fc75-430f-8936-424472313c8e req-a1a81de3-ea08-4da0-b4b8-d1d908643d91 service nova] Creating event network-changed:3a58c362-2e99-4559-9977-3b635ab88161 for instance 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 on hv-cinder-78626 Apr 14 16:12:53.720075 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-ebf42fc5-fc75-430f-8936-424472313c8e req-a1a81de3-ea08-4da0-b4b8-d1d908643d91 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057570 Apr 14 16:12:53.720769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 151/306] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:12:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:53.910840 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a111a0f7-be6a-4aaf-b52b-de637b7a7fc2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:53.921775 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a111a0f7-be6a-4aaf-b52b-de637b7a7fc2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.227338 Apr 14 16:12:53.922709 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 156/307] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:53 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:53.941330 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4f444672-8abe-4295-9b20-83c5db4b3ead tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:53.942509 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4f444672-8abe-4295-9b20-83c5db4b3ead tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:53.951320 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4f444672-8abe-4295-9b20-83c5db4b3ead tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:53.951839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4f444672-8abe-4295-9b20-83c5db4b3ead tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:53.952677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4f444672-8abe-4295-9b20-83c5db4b3ead tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:53.953538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4f444672-8abe-4295-9b20-83c5db4b3ead tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:53.958483 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3146a89e-fbce-4168-92bf-d9c6286954fc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:53.959650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3146a89e-fbce-4168-92bf-d9c6286954fc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:53.968767 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3146a89e-fbce-4168-92bf-d9c6286954fc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:53.969301 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3146a89e-fbce-4168-92bf-d9c6286954fc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:53.970134 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3146a89e-fbce-4168-92bf-d9c6286954fc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:53.970620 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3146a89e-fbce-4168-92bf-d9c6286954fc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:54.130590 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4f444672-8abe-4295-9b20-83c5db4b3ead tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28873 microversion: 2.20 time: 0.193616 Apr 14 16:12:54.132078 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 152/308] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:53 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28873 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:54.208466 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3146a89e-fbce-4168-92bf-d9c6286954fc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 28396 microversion: 2.1 time: 0.253543 Apr 14 16:12:54.213088 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 157/309] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:53 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 28396 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:54.669788 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b67b309b-c8f6-49f6-b441-ad6f21c549de tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:54.670549 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b67b309b-c8f6-49f6-b441-ad6f21c549de tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:54.681223 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b67b309b-c8f6-49f6-b441-ad6f21c549de tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:54.681744 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b67b309b-c8f6-49f6-b441-ad6f21c549de tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:54.682600 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b67b309b-c8f6-49f6-b441-ad6f21c549de tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:54.683096 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b67b309b-c8f6-49f6-b441-ad6f21c549de tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:54.712099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-527392a5-3a15-4ef2-8776-87e3de338639 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:54.713160 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-527392a5-3a15-4ef2-8776-87e3de338639 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:54.722154 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-527392a5-3a15-4ef2-8776-87e3de338639 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:54.722666 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-527392a5-3a15-4ef2-8776-87e3de338639 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:54.723532 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-527392a5-3a15-4ef2-8776-87e3de338639 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:54.724036 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-527392a5-3a15-4ef2-8776-87e3de338639 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:54.888606 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b67b309b-c8f6-49f6-b441-ad6f21c549de tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:54.897828 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b67b309b-c8f6-49f6-b441-ad6f21c549de tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1358 microversion: 2.1 time: 0.233315 Apr 14 16:12:54.898489 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 153/310] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:54 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:54.929834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-527392a5-3a15-4ef2-8776-87e3de338639 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:54.939400 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-527392a5-3a15-4ef2-8776-87e3de338639 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1507 microversion: 2.1 time: 0.232014 Apr 14 16:12:54.939735 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-48afc642-edeb-4e8d-b5d6-05cf00d3b932 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:54.940066 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 158/311] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:54 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:12:54.940410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-48afc642-edeb-4e8d-b5d6-05cf00d3b932 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:54.948386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-48afc642-edeb-4e8d-b5d6-05cf00d3b932 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:54.948901 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-48afc642-edeb-4e8d-b5d6-05cf00d3b932 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:54.950312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-48afc642-edeb-4e8d-b5d6-05cf00d3b932 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:54.950805 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-48afc642-edeb-4e8d-b5d6-05cf00d3b932 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:55.144913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c94b590a-ac8c-457f-8ec7-efed86570405 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:55.146150 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c94b590a-ac8c-457f-8ec7-efed86570405 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:55.154633 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c94b590a-ac8c-457f-8ec7-efed86570405 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:55.155265 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c94b590a-ac8c-457f-8ec7-efed86570405 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:55.156271 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c94b590a-ac8c-457f-8ec7-efed86570405 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:55.156763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c94b590a-ac8c-457f-8ec7-efed86570405 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:55.158619 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-48afc642-edeb-4e8d-b5d6-05cf00d3b932 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:55.167795 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-48afc642-edeb-4e8d-b5d6-05cf00d3b932 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.231980 Apr 14 16:12:55.168610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 154/312] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:54 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:12:55.221535 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-52ffff8e-8f2a-4f94-aa63-9ac8789ce050 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:55.222582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-52ffff8e-8f2a-4f94-aa63-9ac8789ce050 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:55.231929 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-52ffff8e-8f2a-4f94-aa63-9ac8789ce050 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:55.232411 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-52ffff8e-8f2a-4f94-aa63-9ac8789ce050 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:55.233299 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-52ffff8e-8f2a-4f94-aa63-9ac8789ce050 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:55.233789 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-52ffff8e-8f2a-4f94-aa63-9ac8789ce050 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:58.092422 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c94b590a-ac8c-457f-8ec7-efed86570405 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28873 microversion: 2.20 time: 2.952024 Apr 14 16:12:58.095397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 159/313] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:55 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28873 bytes in 2954 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:12:58.099506 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-77a682d7-7251-4103-95cb-ae3a1811b766 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:58.100454 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-77a682d7-7251-4103-95cb-ae3a1811b766 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:58.101191 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-52ffff8e-8f2a-4f94-aa63-9ac8789ce050 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 28687 microversion: 2.1 time: 2.883117 Apr 14 16:12:58.102093 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 155/314] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:55 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 28687 bytes in 2886 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:12:58.130555 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-77a682d7-7251-4103-95cb-ae3a1811b766 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:58.131072 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-77a682d7-7251-4103-95cb-ae3a1811b766 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:58.131933 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-77a682d7-7251-4103-95cb-ae3a1811b766 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:58.132431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-77a682d7-7251-4103-95cb-ae3a1811b766 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:58.135659 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-adf22743-87dd-44bd-acec-40a56554d2c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:58.136550 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-adf22743-87dd-44bd-acec-40a56554d2c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:58.154423 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-adf22743-87dd-44bd-acec-40a56554d2c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:58.154930 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-adf22743-87dd-44bd-acec-40a56554d2c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:58.156165 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-adf22743-87dd-44bd-acec-40a56554d2c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:58.156799 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-adf22743-87dd-44bd-acec-40a56554d2c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:58.365163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-adf22743-87dd-44bd-acec-40a56554d2c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:58.374883 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-adf22743-87dd-44bd-acec-40a56554d2c6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.267220 Apr 14 16:12:58.375522 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 156/315] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:58 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:58.711100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-77a682d7-7251-4103-95cb-ae3a1811b766 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:58.720874 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-77a682d7-7251-4103-95cb-ae3a1811b766 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1358 microversion: 2.1 time: 0.626299 Apr 14 16:12:58.721600 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 160/316] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:58 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1358 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:59.104454 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-01c6f840-fdac-4e9f-a1a7-fce27be8ad4d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:59.105959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-01c6f840-fdac-4e9f-a1a7-fce27be8ad4d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:59.113664 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-53f40796-61e3-4025-b3bf-91eff6b2bce2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:59.114831 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-53f40796-61e3-4025-b3bf-91eff6b2bce2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:59.128008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-01c6f840-fdac-4e9f-a1a7-fce27be8ad4d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:59.128521 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-01c6f840-fdac-4e9f-a1a7-fce27be8ad4d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:59.129408 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-01c6f840-fdac-4e9f-a1a7-fce27be8ad4d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:59.129905 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-01c6f840-fdac-4e9f-a1a7-fce27be8ad4d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:59.142360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-53f40796-61e3-4025-b3bf-91eff6b2bce2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:59.142867 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-53f40796-61e3-4025-b3bf-91eff6b2bce2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:59.143842 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-53f40796-61e3-4025-b3bf-91eff6b2bce2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:59.144327 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-53f40796-61e3-4025-b3bf-91eff6b2bce2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:59.297965 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-01c6f840-fdac-4e9f-a1a7-fce27be8ad4d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28873 microversion: 2.20 time: 0.197321 Apr 14 16:12:59.298719 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 157/317] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:12:59 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28873 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:59.324151 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-53f40796-61e3-4025-b3bf-91eff6b2bce2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 28687 microversion: 2.1 time: 0.214250 Apr 14 16:12:59.325239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 161/318] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:12:59 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 28687 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:12:59.393427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f9f85af5-4b23-404d-8960-05f30a985ab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:59.394126 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f9f85af5-4b23-404d-8960-05f30a985ab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:59.402532 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f9f85af5-4b23-404d-8960-05f30a985ab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:59.403034 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f9f85af5-4b23-404d-8960-05f30a985ab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:59.403865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f9f85af5-4b23-404d-8960-05f30a985ab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:59.404355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f9f85af5-4b23-404d-8960-05f30a985ab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:59.612672 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f9f85af5-4b23-404d-8960-05f30a985ab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:59.622579 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f9f85af5-4b23-404d-8960-05f30a985ab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1521 microversion: 2.1 time: 0.233765 Apr 14 16:12:59.623237 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 158/319] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:59 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:12:59.740594 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b30d874d-6f1e-412c-a564-d1d08e066106 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:12:59.741399 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b30d874d-6f1e-412c-a564-d1d08e066106 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:59.751164 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b30d874d-6f1e-412c-a564-d1d08e066106 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:59.751828 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b30d874d-6f1e-412c-a564-d1d08e066106 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:59.752703 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b30d874d-6f1e-412c-a564-d1d08e066106 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:59.753228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b30d874d-6f1e-412c-a564-d1d08e066106 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:59.796034 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9227d6f4-8579-4d92-8960-9ccdbbd6457e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f54efb8c-5275-4a45-bb91-97e7a91bf57a"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:59.797518 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9227d6f4-8579-4d92-8960-9ccdbbd6457e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:12:59.806257 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9227d6f4-8579-4d92-8960-9ccdbbd6457e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:59.806846 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9227d6f4-8579-4d92-8960-9ccdbbd6457e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:59.808166 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9227d6f4-8579-4d92-8960-9ccdbbd6457e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:12:59.809673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9227d6f4-8579-4d92-8960-9ccdbbd6457e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:12:59.960643 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b30d874d-6f1e-412c-a564-d1d08e066106 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:12:59.970094 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b30d874d-6f1e-412c-a564-d1d08e066106 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1358 microversion: 2.1 time: 0.235130 Apr 14 16:12:59.970725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 162/320] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:12:59 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:00.223021 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9227d6f4-8579-4d92-8960-9ccdbbd6457e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "POST /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431209 Apr 14 16:13:00.224410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 159/321] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Apr 14 16:12:59 2021] POST /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c/os-volume_attachments => generated 194 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:13:00.310820 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0d9b6b61-456c-4207-91bf-96b6872525f8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:00.312093 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0d9b6b61-456c-4207-91bf-96b6872525f8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:00.320679 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d9b6b61-456c-4207-91bf-96b6872525f8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:00.321472 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d9b6b61-456c-4207-91bf-96b6872525f8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:00.322490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d9b6b61-456c-4207-91bf-96b6872525f8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:00.323133 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d9b6b61-456c-4207-91bf-96b6872525f8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:00.348438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-44eb9bfd-25c3-4a2d-98d1-b297826f3973 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:00.350003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-44eb9bfd-25c3-4a2d-98d1-b297826f3973 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:00.375764 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44eb9bfd-25c3-4a2d-98d1-b297826f3973 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:00.380446 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44eb9bfd-25c3-4a2d-98d1-b297826f3973 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:00.381523 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44eb9bfd-25c3-4a2d-98d1-b297826f3973 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:00.382290 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44eb9bfd-25c3-4a2d-98d1-b297826f3973 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:00.513808 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0d9b6b61-456c-4207-91bf-96b6872525f8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28873 microversion: 2.20 time: 0.207247 Apr 14 16:13:00.518217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 163/322] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:00 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28873 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:00.578485 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-44eb9bfd-25c3-4a2d-98d1-b297826f3973 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 28783 microversion: 2.1 time: 0.234698 Apr 14 16:13:00.583146 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 160/323] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:00 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 28783 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:13:00.643272 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-10cbbfe8-197a-4ff0-a382-8d3866b3d67f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:00.644681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-10cbbfe8-197a-4ff0-a382-8d3866b3d67f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:00.655636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10cbbfe8-197a-4ff0-a382-8d3866b3d67f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:00.656419 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10cbbfe8-197a-4ff0-a382-8d3866b3d67f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:00.658278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10cbbfe8-197a-4ff0-a382-8d3866b3d67f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:00.658978 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10cbbfe8-197a-4ff0-a382-8d3866b3d67f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:00.883308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-10cbbfe8-197a-4ff0-a382-8d3866b3d67f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:00.893208 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-10cbbfe8-197a-4ff0-a382-8d3866b3d67f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1501 microversion: 2.1 time: 0.256200 Apr 14 16:13:00.893840 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 164/324] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:00 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1501 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:00.911417 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5a442e06-5475-40cb-ac85-590b9467d36e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:00.912221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5a442e06-5475-40cb-ac85-590b9467d36e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:00.921920 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a442e06-5475-40cb-ac85-590b9467d36e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:00.922430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a442e06-5475-40cb-ac85-590b9467d36e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:00.923271 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a442e06-5475-40cb-ac85-590b9467d36e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:00.923808 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a442e06-5475-40cb-ac85-590b9467d36e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:00.987963 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-91f7f0b0-568d-495c-aeb6-3b2da78f0a38 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:00.989102 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-91f7f0b0-568d-495c-aeb6-3b2da78f0a38 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:00.997741 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-91f7f0b0-568d-495c-aeb6-3b2da78f0a38 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:00.998260 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-91f7f0b0-568d-495c-aeb6-3b2da78f0a38 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:00.999259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-91f7f0b0-568d-495c-aeb6-3b2da78f0a38 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:00.999754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-91f7f0b0-568d-495c-aeb6-3b2da78f0a38 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:01.130582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5a442e06-5475-40cb-ac85-590b9467d36e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:01.148130 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5a442e06-5475-40cb-ac85-590b9467d36e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1514 microversion: 2.1 time: 0.241329 Apr 14 16:13:01.148794 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 161/325] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:00 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:01.275965 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-91f7f0b0-568d-495c-aeb6-3b2da78f0a38 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:01.286630 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-91f7f0b0-568d-495c-aeb6-3b2da78f0a38 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1358 microversion: 2.1 time: 0.302626 Apr 14 16:13:01.287597 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 165/326] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:00 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:01.526798 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3a1e084b-3019-4e08-a8ff-21b0f35cbaba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:01.528403 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3a1e084b-3019-4e08-a8ff-21b0f35cbaba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:01.537546 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3a1e084b-3019-4e08-a8ff-21b0f35cbaba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:01.538515 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3a1e084b-3019-4e08-a8ff-21b0f35cbaba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:01.540095 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3a1e084b-3019-4e08-a8ff-21b0f35cbaba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:01.540760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3a1e084b-3019-4e08-a8ff-21b0f35cbaba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:01.599645 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9a4cf402-e9d6-485b-b675-ea5c40dff56c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:01.601518 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9a4cf402-e9d6-485b-b675-ea5c40dff56c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:01.617423 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9a4cf402-e9d6-485b-b675-ea5c40dff56c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:01.618187 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9a4cf402-e9d6-485b-b675-ea5c40dff56c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:01.619214 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9a4cf402-e9d6-485b-b675-ea5c40dff56c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:01.619912 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9a4cf402-e9d6-485b-b675-ea5c40dff56c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:01.731936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3a1e084b-3019-4e08-a8ff-21b0f35cbaba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28873 microversion: 2.20 time: 0.207323 Apr 14 16:13:01.733629 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 162/327] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:01 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28873 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:01.803544 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9a4cf402-e9d6-485b-b675-ea5c40dff56c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 29055 microversion: 2.1 time: 0.215995 Apr 14 16:13:01.807751 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 166/328] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:01 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 29055 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:02.307048 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-79fd0334-6f99-4e98-bb40-9fcdb86cea9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:02.308699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-79fd0334-6f99-4e98-bb40-9fcdb86cea9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:02.320507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79fd0334-6f99-4e98-bb40-9fcdb86cea9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:02.321456 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79fd0334-6f99-4e98-bb40-9fcdb86cea9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:02.322570 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79fd0334-6f99-4e98-bb40-9fcdb86cea9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:02.323311 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79fd0334-6f99-4e98-bb40-9fcdb86cea9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:02.749518 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-afef8af4-f69c-454e-80d9-761d9f89ab4a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:02.749518 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-afef8af4-f69c-454e-80d9-761d9f89ab4a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:02.760166 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-afef8af4-f69c-454e-80d9-761d9f89ab4a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:02.760796 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-afef8af4-f69c-454e-80d9-761d9f89ab4a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:02.762551 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-afef8af4-f69c-454e-80d9-761d9f89ab4a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:02.763172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-afef8af4-f69c-454e-80d9-761d9f89ab4a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:02.838133 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-79fd0334-6f99-4e98-bb40-9fcdb86cea9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:02.851061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-79fd0334-6f99-4e98-bb40-9fcdb86cea9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1358 microversion: 2.1 time: 0.549159 Apr 14 16:13:02.851841 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 163/329] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:02 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1358 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:02.876715 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9f500b46-57d2-4fae-bdb2-80afcf558f63 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:02.877940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9f500b46-57d2-4fae-bdb2-80afcf558f63 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:02.894720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9f500b46-57d2-4fae-bdb2-80afcf558f63 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:02.895211 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9f500b46-57d2-4fae-bdb2-80afcf558f63 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:02.898608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9f500b46-57d2-4fae-bdb2-80afcf558f63 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:02.900434 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9f500b46-57d2-4fae-bdb2-80afcf558f63 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:02.907360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-afef8af4-f69c-454e-80d9-761d9f89ab4a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28873 microversion: 2.20 time: 0.164641 Apr 14 16:13:02.907360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 167/330] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:02 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28873 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:03.018363 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-37da1a9c-d03d-46e5-8583-ae449b2a2507 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:03.020530 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-37da1a9c-d03d-46e5-8583-ae449b2a2507 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:03.031552 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-37da1a9c-d03d-46e5-8583-ae449b2a2507 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:03.032055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-37da1a9c-d03d-46e5-8583-ae449b2a2507 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:03.033461 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-37da1a9c-d03d-46e5-8583-ae449b2a2507 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:03.033962 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-37da1a9c-d03d-46e5-8583-ae449b2a2507 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:03.102920 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-37da1a9c-d03d-46e5-8583-ae449b2a2507 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lazy-loading 'flavor' on Instance uuid 0a704e48-ff08-4961-9c93-7a0fdf04543d {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:13:03.104942 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9f500b46-57d2-4fae-bdb2-80afcf558f63 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 29057 microversion: 2.1 time: 0.241018 Apr 14 16:13:03.106277 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 164/331] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:02 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 29057 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:03.287109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-37da1a9c-d03d-46e5-8583-ae449b2a2507 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "POST /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/action" status: 200 len: 32 microversion: 2.1 time: 0.273052 Apr 14 16:13:03.288420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 168/332] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:03 2021] POST /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/action => generated 32 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:13:03.299650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1ff776e7-b718-4974-838d-9e5a4da38085 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:03.300610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1ff776e7-b718-4974-838d-9e5a4da38085 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:03.310922 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1ff776e7-b718-4974-838d-9e5a4da38085 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:03.311624 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1ff776e7-b718-4974-838d-9e5a4da38085 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:03.312714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1ff776e7-b718-4974-838d-9e5a4da38085 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:03.313363 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1ff776e7-b718-4974-838d-9e5a4da38085 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:03.544131 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1ff776e7-b718-4974-838d-9e5a4da38085 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:03.553288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1ff776e7-b718-4974-838d-9e5a4da38085 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.258972 Apr 14 16:13:03.566751 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 165/333] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:03 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:03.874438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-376ac51a-a70b-407c-93cb-5c5aa18c3992 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:03.875311 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-376ac51a-a70b-407c-93cb-5c5aa18c3992 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:03.887396 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-376ac51a-a70b-407c-93cb-5c5aa18c3992 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:03.888282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-376ac51a-a70b-407c-93cb-5c5aa18c3992 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:03.890312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-376ac51a-a70b-407c-93cb-5c5aa18c3992 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:03.891005 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-376ac51a-a70b-407c-93cb-5c5aa18c3992 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:03.920350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-eef65871-c06f-4f7c-a948-7a7ef4e0f7e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:03.921903 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-eef65871-c06f-4f7c-a948-7a7ef4e0f7e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:03.941485 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eef65871-c06f-4f7c-a948-7a7ef4e0f7e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:03.942596 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eef65871-c06f-4f7c-a948-7a7ef4e0f7e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:03.944036 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eef65871-c06f-4f7c-a948-7a7ef4e0f7e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:03.944971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eef65871-c06f-4f7c-a948-7a7ef4e0f7e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:04.102115 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-eef65871-c06f-4f7c-a948-7a7ef4e0f7e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 28873 microversion: 2.20 time: 0.188221 Apr 14 16:13:04.106846 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 166/334] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:03 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 28873 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:13:04.127040 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f9d81d64-8cf1-434e-8056-3817e510fab7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:04.130367 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f9d81d64-8cf1-434e-8056-3817e510fab7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:04.163080 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f9d81d64-8cf1-434e-8056-3817e510fab7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:04.164100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f9d81d64-8cf1-434e-8056-3817e510fab7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:04.165284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f9d81d64-8cf1-434e-8056-3817e510fab7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:04.166840 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f9d81d64-8cf1-434e-8056-3817e510fab7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:04.332084 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-376ac51a-a70b-407c-93cb-5c5aa18c3992 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:04.352770 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-376ac51a-a70b-407c-93cb-5c5aa18c3992 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1358 microversion: 2.1 time: 0.483472 Apr 14 16:13:04.353575 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 169/335] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:03 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1358 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:04.371628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f9d81d64-8cf1-434e-8056-3817e510fab7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 29057 microversion: 2.1 time: 0.253684 Apr 14 16:13:04.376972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 167/336] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:04 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 29057 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:04.576278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-895d9e43-2e32-4de1-b4b9-1b68bfd6d8cb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:04.578817 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-895d9e43-2e32-4de1-b4b9-1b68bfd6d8cb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:04.587873 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-895d9e43-2e32-4de1-b4b9-1b68bfd6d8cb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:04.588582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-895d9e43-2e32-4de1-b4b9-1b68bfd6d8cb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:04.589638 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-895d9e43-2e32-4de1-b4b9-1b68bfd6d8cb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:04.590199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-895d9e43-2e32-4de1-b4b9-1b68bfd6d8cb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:04.864420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-895d9e43-2e32-4de1-b4b9-1b68bfd6d8cb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:04.874360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-895d9e43-2e32-4de1-b4b9-1b68bfd6d8cb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.303406 Apr 14 16:13:04.875007 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 170/337] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:04 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:05.116054 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-80bc7fd6-d867-487f-bce7-d6b9bb952e47 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:05.117998 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-80bc7fd6-d867-487f-bce7-d6b9bb952e47 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:05.141488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-80bc7fd6-d867-487f-bce7-d6b9bb952e47 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:05.141876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-80bc7fd6-d867-487f-bce7-d6b9bb952e47 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:05.142829 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-80bc7fd6-d867-487f-bce7-d6b9bb952e47 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:05.143372 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-80bc7fd6-d867-487f-bce7-d6b9bb952e47 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:05.291943 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-80bc7fd6-d867-487f-bce7-d6b9bb952e47 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 29554 microversion: 2.20 time: 0.180441 Apr 14 16:13:05.294391 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 168/338] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:05 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 29554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:05.372880 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c4c674d1-4e98-461c-9023-83b0a124b029 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:05.374273 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c4c674d1-4e98-461c-9023-83b0a124b029 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:05.382306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4c674d1-4e98-461c-9023-83b0a124b029 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:05.382809 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4c674d1-4e98-461c-9023-83b0a124b029 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:05.383784 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4c674d1-4e98-461c-9023-83b0a124b029 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:05.384281 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4c674d1-4e98-461c-9023-83b0a124b029 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:05.386499 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-efe785ae-b1f5-430c-8264-3f6ddf8f2e10 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:05.388550 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-efe785ae-b1f5-430c-8264-3f6ddf8f2e10 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:05.398357 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-efe785ae-b1f5-430c-8264-3f6ddf8f2e10 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:05.399817 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-efe785ae-b1f5-430c-8264-3f6ddf8f2e10 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:05.400766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-efe785ae-b1f5-430c-8264-3f6ddf8f2e10 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:05.401507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-efe785ae-b1f5-430c-8264-3f6ddf8f2e10 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:05.560347 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-efe785ae-b1f5-430c-8264-3f6ddf8f2e10 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 29057 microversion: 2.1 time: 0.179302 Apr 14 16:13:05.561313 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 169/339] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:05 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 29057 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:05.570777 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-0ebb0b8b-6623-49a6-9cc9-93c50201ed93 req-3545f2b3-0099-4afe-860e-ef843c0c3d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93346a14-b6f5-4d77-a1a7-f4d649c7ccd5", "name": "network-vif-plugged", "status": "completed", "tag": "3a58c362-2e99-4559-9977-3b635ab88161"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:05.572569 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:13:05.572569 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:13:05.596491 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-0ebb0b8b-6623-49a6-9cc9-93c50201ed93 req-3545f2b3-0099-4afe-860e-ef843c0c3d3a service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:05.596998 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-0ebb0b8b-6623-49a6-9cc9-93c50201ed93 req-3545f2b3-0099-4afe-860e-ef843c0c3d3a service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:05.619438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c4c674d1-4e98-461c-9023-83b0a124b029 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:05.638044 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-0ebb0b8b-6623-49a6-9cc9-93c50201ed93 req-3545f2b3-0099-4afe-860e-ef843c0c3d3a service nova] Creating event network-vif-plugged:3a58c362-2e99-4559-9977-3b635ab88161 for instance 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 on hv-cinder-78626 Apr 14 16:13:05.647320 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-0ebb0b8b-6623-49a6-9cc9-93c50201ed93 req-3545f2b3-0099-4afe-860e-ef843c0c3d3a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084381 Apr 14 16:13:05.648968 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 170/340] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:13:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:13:05.654835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c4c674d1-4e98-461c-9023-83b0a124b029 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1358 microversion: 2.1 time: 0.286741 Apr 14 16:13:05.658175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 171/341] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:05 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1358 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:05.893536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d78fd3a7-f950-4170-beb5-f223140803b6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:05.894361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d78fd3a7-f950-4170-beb5-f223140803b6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:05.922240 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d78fd3a7-f950-4170-beb5-f223140803b6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:05.922786 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d78fd3a7-f950-4170-beb5-f223140803b6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:05.923863 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d78fd3a7-f950-4170-beb5-f223140803b6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:05.924164 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d78fd3a7-f950-4170-beb5-f223140803b6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:06.282587 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d78fd3a7-f950-4170-beb5-f223140803b6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:06.292128 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d78fd3a7-f950-4170-beb5-f223140803b6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.403383 Apr 14 16:13:06.302194 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 171/342] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:05 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:06.304776 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-76c281d3-7392-432e-92f7-4c2d21b668e2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:06.305872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-76c281d3-7392-432e-92f7-4c2d21b668e2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:06.315342 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-76c281d3-7392-432e-92f7-4c2d21b668e2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:06.315848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-76c281d3-7392-432e-92f7-4c2d21b668e2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:06.316691 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-76c281d3-7392-432e-92f7-4c2d21b668e2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:06.317208 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-76c281d3-7392-432e-92f7-4c2d21b668e2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:06.473344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-76c281d3-7392-432e-92f7-4c2d21b668e2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 30219 microversion: 2.20 time: 0.172810 Apr 14 16:13:06.474191 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 172/343] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:06 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 30219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:06.576961 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3c4370d9-ed25-4494-af45-026da77d4253 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:06.578529 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3c4370d9-ed25-4494-af45-026da77d4253 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:06.586851 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c4370d9-ed25-4494-af45-026da77d4253 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:06.587361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c4370d9-ed25-4494-af45-026da77d4253 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:06.588212 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c4370d9-ed25-4494-af45-026da77d4253 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:06.588700 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c4370d9-ed25-4494-af45-026da77d4253 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:06.674721 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-46892267-695a-49ca-80ce-1e3e9dd33903 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:06.675348 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-46892267-695a-49ca-80ce-1e3e9dd33903 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:06.685227 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-46892267-695a-49ca-80ce-1e3e9dd33903 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:06.685699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-46892267-695a-49ca-80ce-1e3e9dd33903 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:06.686605 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-46892267-695a-49ca-80ce-1e3e9dd33903 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:06.687029 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-46892267-695a-49ca-80ce-1e3e9dd33903 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:06.739146 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3c4370d9-ed25-4494-af45-026da77d4253 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 29057 microversion: 2.1 time: 0.166330 Apr 14 16:13:06.740935 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 172/344] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:06 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 29057 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:07.099533 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-46892267-695a-49ca-80ce-1e3e9dd33903 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:07.114266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-46892267-695a-49ca-80ce-1e3e9dd33903 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1358 microversion: 2.1 time: 0.445823 Apr 14 16:13:07.114949 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 173/345] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:06 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1358 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:13:07.313237 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-34f80fdb-2550-4777-bf54-428a23ed8957 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:07.313991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-34f80fdb-2550-4777-bf54-428a23ed8957 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:07.329124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-34f80fdb-2550-4777-bf54-428a23ed8957 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:07.332014 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-34f80fdb-2550-4777-bf54-428a23ed8957 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:07.342930 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-34f80fdb-2550-4777-bf54-428a23ed8957 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:07.343444 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-34f80fdb-2550-4777-bf54-428a23ed8957 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:07.487654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5399f02f-b0d6-4696-86e5-1fc7648ad188 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:07.489134 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5399f02f-b0d6-4696-86e5-1fc7648ad188 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:07.497730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5399f02f-b0d6-4696-86e5-1fc7648ad188 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:07.498227 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5399f02f-b0d6-4696-86e5-1fc7648ad188 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:07.499064 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5399f02f-b0d6-4696-86e5-1fc7648ad188 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:07.500294 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5399f02f-b0d6-4696-86e5-1fc7648ad188 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:07.636408 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-34f80fdb-2550-4777-bf54-428a23ed8957 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:07.645996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-34f80fdb-2550-4777-bf54-428a23ed8957 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.339026 Apr 14 16:13:07.647095 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 173/346] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:07 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:07.650534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5399f02f-b0d6-4696-86e5-1fc7648ad188 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 30785 microversion: 2.20 time: 0.168763 Apr 14 16:13:07.651224 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 174/347] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:07 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 30785 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:13:07.752912 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4f2930c9-f74a-458e-a469-15e48fb7d3e1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:07.754235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4f2930c9-f74a-458e-a469-15e48fb7d3e1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:07.764644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4f2930c9-f74a-458e-a469-15e48fb7d3e1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:07.765535 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4f2930c9-f74a-458e-a469-15e48fb7d3e1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:07.766892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4f2930c9-f74a-458e-a469-15e48fb7d3e1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:07.767533 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4f2930c9-f74a-458e-a469-15e48fb7d3e1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:07.939514 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4f2930c9-f74a-458e-a469-15e48fb7d3e1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 29057 microversion: 2.1 time: 0.190307 Apr 14 16:13:07.940786 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 174/348] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:07 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 29057 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:08.132928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-04b2df74-8657-464b-9de1-099c32e15083 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:08.150104 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-04b2df74-8657-464b-9de1-099c32e15083 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:08.210374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-04b2df74-8657-464b-9de1-099c32e15083 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:08.222889 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-04b2df74-8657-464b-9de1-099c32e15083 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:08.224201 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-04b2df74-8657-464b-9de1-099c32e15083 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:08.229670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-04b2df74-8657-464b-9de1-099c32e15083 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:08.566898 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-04b2df74-8657-464b-9de1-099c32e15083 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:08.576912 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-04b2df74-8657-464b-9de1-099c32e15083 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1548 microversion: 2.1 time: 0.448565 Apr 14 16:13:08.577567 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 175/349] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:08 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1548 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:08.596354 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-adca86ca-0756-4b0c-bbe3-990a0e216e19 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:08.597648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-adca86ca-0756-4b0c-bbe3-990a0e216e19 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:08.607656 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-adca86ca-0756-4b0c-bbe3-990a0e216e19 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:08.608508 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-adca86ca-0756-4b0c-bbe3-990a0e216e19 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:08.609503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-adca86ca-0756-4b0c-bbe3-990a0e216e19 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:08.610159 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-adca86ca-0756-4b0c-bbe3-990a0e216e19 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:08.664170 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-25eed53f-fe19-4045-8ac7-243df2fbf0f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:08.665574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-25eed53f-fe19-4045-8ac7-243df2fbf0f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:08.674304 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25eed53f-fe19-4045-8ac7-243df2fbf0f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:08.675163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25eed53f-fe19-4045-8ac7-243df2fbf0f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:08.676162 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25eed53f-fe19-4045-8ac7-243df2fbf0f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:08.676797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25eed53f-fe19-4045-8ac7-243df2fbf0f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:08.811682 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-25eed53f-fe19-4045-8ac7-243df2fbf0f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 31139 microversion: 2.20 time: 0.151372 Apr 14 16:13:08.813262 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 176/350] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:08 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 31139 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:08.818688 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-96da338b-85ec-4e6a-9989-292fa22d17d4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:08.819413 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-96da338b-85ec-4e6a-9989-292fa22d17d4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:08.829023 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-96da338b-85ec-4e6a-9989-292fa22d17d4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:08.829689 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-96da338b-85ec-4e6a-9989-292fa22d17d4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:08.830686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-96da338b-85ec-4e6a-9989-292fa22d17d4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:08.831295 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-96da338b-85ec-4e6a-9989-292fa22d17d4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:09.004210 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-adca86ca-0756-4b0c-bbe3-990a0e216e19 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:09.020215 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-adca86ca-0756-4b0c-bbe3-990a0e216e19 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1548 microversion: 2.1 time: 0.428286 Apr 14 16:13:09.021162 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 175/351] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:08 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1548 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:09.057880 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9c663b6f-6643-43ae-8e8d-98df3e83cb6e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:09.063343 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9c663b6f-6643-43ae-8e8d-98df3e83cb6e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:09.076312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c663b6f-6643-43ae-8e8d-98df3e83cb6e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:09.077084 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c663b6f-6643-43ae-8e8d-98df3e83cb6e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:09.078138 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c663b6f-6643-43ae-8e8d-98df3e83cb6e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:09.078792 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c663b6f-6643-43ae-8e8d-98df3e83cb6e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:09.082959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-96da338b-85ec-4e6a-9989-292fa22d17d4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:09.094948 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-96da338b-85ec-4e6a-9989-292fa22d17d4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.280695 Apr 14 16:13:09.095913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 177/352] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:08 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:09.100987 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1271c3e4-06dd-4564-9215-a5a314638aef tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:09.105517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:13:09.105517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:13:09.107769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1271c3e4-06dd-4564-9215-a5a314638aef tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:09.108862 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1271c3e4-06dd-4564-9215-a5a314638aef tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Searching by: {'deleted': False, 'project_id': '8e71c42092894db98f8db75a2719f751'} {{(pid=99334) get_all /opt/stack/nova/nova/compute/api.py:2857}} Apr 14 16:13:09.115914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1271c3e4-06dd-4564-9215-a5a314638aef tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:09.115914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1271c3e4-06dd-4564-9215-a5a314638aef tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:09.116800 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1271c3e4-06dd-4564-9215-a5a314638aef tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:09.117342 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1271c3e4-06dd-4564-9215-a5a314638aef tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:09.230722 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9c663b6f-6643-43ae-8e8d-98df3e83cb6e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 29057 microversion: 2.1 time: 0.189934 Apr 14 16:13:09.231707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 176/353] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:09 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 29057 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:09.243577 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.multi_cell_list [None req-1271c3e4-06dd-4564-9215-a5a314638aef tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=99334) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Apr 14 16:13:09.352533 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1271c3e4-06dd-4564-9215-a5a314638aef tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.255434 Apr 14 16:13:09.353500 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 178/354] 10.222.0.60 () {58 vars in 1115 bytes} [Wed Apr 14 16:13:09 2021] GET /compute/v2.1/servers => generated 343 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:13:09.366091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-33906797-aeda-429e-836a-4f6fa3b70fbc tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:09.367097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-33906797-aeda-429e-836a-4f6fa3b70fbc tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:09.376636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-33906797-aeda-429e-836a-4f6fa3b70fbc tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:09.377183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-33906797-aeda-429e-836a-4f6fa3b70fbc tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:09.378410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-33906797-aeda-429e-836a-4f6fa3b70fbc tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:09.378988 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-33906797-aeda-429e-836a-4f6fa3b70fbc tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:09.700394 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c0584844-14bf-4f2d-8664-18ee500ede6d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f54efb8c-5275-4a45-bb91-97e7a91bf57a"}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:09.701862 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c0584844-14bf-4f2d-8664-18ee500ede6d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:09.710590 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0584844-14bf-4f2d-8664-18ee500ede6d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:09.711427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0584844-14bf-4f2d-8664-18ee500ede6d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:09.712420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0584844-14bf-4f2d-8664-18ee500ede6d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:09.712995 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0584844-14bf-4f2d-8664-18ee500ede6d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:09.936182 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-c0584844-14bf-4f2d-8664-18ee500ede6d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] HTTP exception thrown: Invalid volume: volume f54efb8c-5275-4a45-bb91-97e7a91bf57a is already attached to instances: fb6b11f7-562d-499f-8db6-48e991d6802c Apr 14 16:13:09.939782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c0584844-14bf-4f2d-8664-18ee500ede6d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Returning 400 to user: Invalid volume: volume f54efb8c-5275-4a45-bb91-97e7a91bf57a is already attached to instances: fb6b11f7-562d-499f-8db6-48e991d6802c {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:13:09.941994 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c0584844-14bf-4f2d-8664-18ee500ede6d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "POST /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.247255 Apr 14 16:13:09.942892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 179/355] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Apr 14 16:13:09 2021] POST /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c/os-volume_attachments => generated 174 bytes in 249 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 16:13:09.952455 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3897ae15-9e45-4657-b65a-00db4fc8a830 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:09.957236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3897ae15-9e45-4657-b65a-00db4fc8a830 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:09.967662 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3897ae15-9e45-4657-b65a-00db4fc8a830 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:09.968260 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3897ae15-9e45-4657-b65a-00db4fc8a830 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:09.969804 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3897ae15-9e45-4657-b65a-00db4fc8a830 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:09.970400 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3897ae15-9e45-4657-b65a-00db4fc8a830 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:09.992089 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-33906797-aeda-429e-836a-4f6fa3b70fbc tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:10.015451 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-33906797-aeda-429e-836a-4f6fa3b70fbc tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1548 microversion: 2.1 time: 0.654169 Apr 14 16:13:10.016117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 177/356] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:09 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1548 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:10.114508 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b88ad682-eb43-4402-9f0b-05ee39ec6b78 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:10.115699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b88ad682-eb43-4402-9f0b-05ee39ec6b78 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:10.142244 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3897ae15-9e45-4657-b65a-00db4fc8a830 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 31996 microversion: 2.20 time: 0.194452 Apr 14 16:13:10.146470 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 180/357] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:09 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 31996 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:10.149497 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b88ad682-eb43-4402-9f0b-05ee39ec6b78 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:10.150326 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b88ad682-eb43-4402-9f0b-05ee39ec6b78 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:10.156624 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b88ad682-eb43-4402-9f0b-05ee39ec6b78 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:10.164913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b88ad682-eb43-4402-9f0b-05ee39ec6b78 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:10.179394 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-28311563-d7d6-4b12-9e10-75b5920ba289 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:10.182348 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-28311563-d7d6-4b12-9e10-75b5920ba289 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:10.203219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-28311563-d7d6-4b12-9e10-75b5920ba289 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:10.204016 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-28311563-d7d6-4b12-9e10-75b5920ba289 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:10.205127 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-28311563-d7d6-4b12-9e10-75b5920ba289 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:10.205818 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-28311563-d7d6-4b12-9e10-75b5920ba289 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:10.596607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-28311563-d7d6-4b12-9e10-75b5920ba289 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lazy-loading 'services' on Instance uuid fb6b11f7-562d-499f-8db6-48e991d6802c {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:13:10.606679 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b88ad682-eb43-4402-9f0b-05ee39ec6b78 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:10.619086 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b88ad682-eb43-4402-9f0b-05ee39ec6b78 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.510616 Apr 14 16:13:10.619713 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 178/358] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:10 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:13:10.628307 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-91581eee-42b4-4581-bae0-a968252819ac tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:10.631993 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-91581eee-42b4-4581-bae0-a968252819ac tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:10.651870 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-91581eee-42b4-4581-bae0-a968252819ac tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:10.658407 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-91581eee-42b4-4581-bae0-a968252819ac tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:10.659504 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-91581eee-42b4-4581-bae0-a968252819ac tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:10.660124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-91581eee-42b4-4581-bae0-a968252819ac tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:10.814987 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-28311563-d7d6-4b12-9e10-75b5920ba289 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c/os-volume_attachments/f54efb8c-5275-4a45-bb91-97e7a91bf57a" status: 202 len: 0 microversion: 2.1 time: 0.666657 Apr 14 16:13:10.815699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 181/359] 10.222.0.60 () {58 vars in 1406 bytes} [Wed Apr 14 16:13:10 2021] DELETE /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c/os-volume_attachments/f54efb8c-5275-4a45-bb91-97e7a91bf57a => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:10.888584 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-91581eee-42b4-4581-bae0-a968252819ac tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 29057 microversion: 2.1 time: 0.263990 Apr 14 16:13:10.889380 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 179/360] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:10 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 29057 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:11.159175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5e021289-4aa0-4f6b-90ab-34060ac21e90 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:11.160424 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5e021289-4aa0-4f6b-90ab-34060ac21e90 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:11.170180 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e021289-4aa0-4f6b-90ab-34060ac21e90 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:11.170688 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e021289-4aa0-4f6b-90ab-34060ac21e90 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:11.171542 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e021289-4aa0-4f6b-90ab-34060ac21e90 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:11.172029 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e021289-4aa0-4f6b-90ab-34060ac21e90 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:11.323516 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5e021289-4aa0-4f6b-90ab-34060ac21e90 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 32731 microversion: 2.20 time: 0.169038 Apr 14 16:13:11.324846 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 182/361] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:11 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 32731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:11.640264 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1bf45e7d-094a-4907-b95f-ead7c55bcde6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:11.641078 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1bf45e7d-094a-4907-b95f-ead7c55bcde6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:11.650602 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1bf45e7d-094a-4907-b95f-ead7c55bcde6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:11.651390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1bf45e7d-094a-4907-b95f-ead7c55bcde6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:11.652980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1bf45e7d-094a-4907-b95f-ead7c55bcde6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:11.653712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1bf45e7d-094a-4907-b95f-ead7c55bcde6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:11.900914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-07386bef-3cb8-4173-b2c3-ec63b06ad70e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:11.903277 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-07386bef-3cb8-4173-b2c3-ec63b06ad70e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:11.927449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-07386bef-3cb8-4173-b2c3-ec63b06ad70e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:11.927971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-07386bef-3cb8-4173-b2c3-ec63b06ad70e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:11.930445 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-07386bef-3cb8-4173-b2c3-ec63b06ad70e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:11.930952 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-07386bef-3cb8-4173-b2c3-ec63b06ad70e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:12.141919 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-07386bef-3cb8-4173-b2c3-ec63b06ad70e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 29057 microversion: 2.1 time: 0.245282 Apr 14 16:13:12.143050 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 183/362] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:11 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 29057 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:12.337541 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-94559c69-fc92-4e37-8eaf-8f5257e4a279 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:12.338626 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-94559c69-fc92-4e37-8eaf-8f5257e4a279 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:12.355051 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94559c69-fc92-4e37-8eaf-8f5257e4a279 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:12.355835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94559c69-fc92-4e37-8eaf-8f5257e4a279 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:12.356847 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94559c69-fc92-4e37-8eaf-8f5257e4a279 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:12.357501 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94559c69-fc92-4e37-8eaf-8f5257e4a279 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:12.555306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-94559c69-fc92-4e37-8eaf-8f5257e4a279 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 33203 microversion: 2.20 time: 0.222557 Apr 14 16:13:12.561865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 184/363] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:12 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 33203 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:13:12.676355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1bf45e7d-094a-4907-b95f-ead7c55bcde6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:12.690661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-84ae2045-dbd6-4076-b512-61252f3ff5aa tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25677951-214b-4900-84ec-025fdeaf0307"}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:12.692747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-84ae2045-dbd6-4076-b512-61252f3ff5aa tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:12.701974 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1bf45e7d-094a-4907-b95f-ead7c55bcde6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 1.063493 Apr 14 16:13:12.702874 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 180/364] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:11 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:12.704401 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84ae2045-dbd6-4076-b512-61252f3ff5aa tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:12.705515 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84ae2045-dbd6-4076-b512-61252f3ff5aa tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:12.706650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84ae2045-dbd6-4076-b512-61252f3ff5aa tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:12.707432 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84ae2045-dbd6-4076-b512-61252f3ff5aa tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:13.156002 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-15a146ac-10b0-4443-9896-70b3d5a91f0d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:13.157219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-15a146ac-10b0-4443-9896-70b3d5a91f0d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:13.177309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-15a146ac-10b0-4443-9896-70b3d5a91f0d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:13.178098 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-15a146ac-10b0-4443-9896-70b3d5a91f0d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:13.179275 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-15a146ac-10b0-4443-9896-70b3d5a91f0d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:13.179933 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-15a146ac-10b0-4443-9896-70b3d5a91f0d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:13.201598 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-84ae2045-dbd6-4076-b512-61252f3ff5aa tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "POST /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515869 Apr 14 16:13:13.203195 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 185/365] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Apr 14 16:13:12 2021] POST /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/os-volume_attachments => generated 194 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:13:13.381301 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-15a146ac-10b0-4443-9896-70b3d5a91f0d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 29057 microversion: 2.1 time: 0.230802 Apr 14 16:13:13.385750 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 181/366] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:13 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 29057 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:13.442148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1866985647", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452", "networks": [{"uuid": "2513cfaf-5700-4daa-9c93-a6579fd80809"}]}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:13.521093 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] validate_networks() for [('2513cfaf-5700-4daa-9c93-a6579fd80809', None, None, None)] {{(pid=99334) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:13:13.569305 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-378b2551-a97a-401c-9b56-189376619d2c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:13.570568 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-378b2551-a97a-401c-9b56-189376619d2c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:13.583106 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-378b2551-a97a-401c-9b56-189376619d2c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:13.588792 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-378b2551-a97a-401c-9b56-189376619d2c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:13.591948 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-378b2551-a97a-401c-9b56-189376619d2c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:13.596985 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-378b2551-a97a-401c-9b56-189376619d2c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:13.925524 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-378b2551-a97a-401c-9b56-189376619d2c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 35396 microversion: 2.20 time: 0.360663 Apr 14 16:13:13.927051 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 182/367] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:13 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 35396 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:13.937570 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7c122a73-0e0a-4145-b5af-a4903015e5f3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:13.940438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7c122a73-0e0a-4145-b5af-a4903015e5f3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:13.958963 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7c122a73-0e0a-4145-b5af-a4903015e5f3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:13.963036 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7c122a73-0e0a-4145-b5af-a4903015e5f3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:13.967904 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7c122a73-0e0a-4145-b5af-a4903015e5f3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:13.969361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7c122a73-0e0a-4145-b5af-a4903015e5f3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:14.410942 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Flavor limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:13:14.411366 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Image limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:13:14.411730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Flavor pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:13:14.412475 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Image pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:13:14.413575 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:13:14.428563 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:14.429486 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:14.430503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:14.431945 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:14.463251 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Getting quotas for project b8a4298bacf14cd493bcec2e3543ab00. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:13:14.468875 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Getting quotas for user 8a19cff22a01451e8d454b8a8f4cde89 and project b8a4298bacf14cd493bcec2e3543ab00. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:13:14.486763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Going to run 1 instances... {{(pid=99334) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:13:14.498116 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:13:14.567430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8e0707e8-9c7d-4a9a-a7c5-3dcecc7f628c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.130255 Apr 14 16:13:14.568416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 186/368] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:13:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:13:14.575358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c4e8b680-6d13-47d1-8331-7b680ab6dadf tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:14.577474 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c4e8b680-6d13-47d1-8331-7b680ab6dadf tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:14.590648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4e8b680-6d13-47d1-8331-7b680ab6dadf tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:14.591260 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7c122a73-0e0a-4145-b5af-a4903015e5f3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:14.591531 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4e8b680-6d13-47d1-8331-7b680ab6dadf tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:14.592994 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4e8b680-6d13-47d1-8331-7b680ab6dadf tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:14.603854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7c122a73-0e0a-4145-b5af-a4903015e5f3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.675035 Apr 14 16:13:14.604735 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 183/369] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:13 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:14.606865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4e8b680-6d13-47d1-8331-7b680ab6dadf tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:14.611422 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cfedd2ff-a70d-48fe-a9e9-39affd719e83 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:14.612366 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cfedd2ff-a70d-48fe-a9e9-39affd719e83 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:14.776036 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cfedd2ff-a70d-48fe-a9e9-39affd719e83 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:14.794203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c4e8b680-6d13-47d1-8331-7b680ab6dadf tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 29057 microversion: 2.1 time: 0.223078 Apr 14 16:13:14.794808 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 187/370] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:14 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 29057 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:14.799253 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cfedd2ff-a70d-48fe-a9e9-39affd719e83 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1218 microversion: 2.1 time: 0.192534 Apr 14 16:13:14.799876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 184/371] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:14 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1218 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:14.943265 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-84dcd7a4-143f-400b-a27f-41651acb25a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:14.944711 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-84dcd7a4-143f-400b-a27f-41651acb25a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:14.954730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84dcd7a4-143f-400b-a27f-41651acb25a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:14.955411 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84dcd7a4-143f-400b-a27f-41651acb25a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:14.956393 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84dcd7a4-143f-400b-a27f-41651acb25a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:14.957003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84dcd7a4-143f-400b-a27f-41651acb25a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:15.095258 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-84dcd7a4-143f-400b-a27f-41651acb25a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 35620 microversion: 2.20 time: 0.158797 Apr 14 16:13:15.096483 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 188/372] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:14 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 35620 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:13:15.630413 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-33c71af5-1a95-4f71-9974-a56b0f2601df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:15.631096 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-33c71af5-1a95-4f71-9974-a56b0f2601df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:15.660449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-33c71af5-1a95-4f71-9974-a56b0f2601df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:15.660866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-33c71af5-1a95-4f71-9974-a56b0f2601df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:15.661924 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-33c71af5-1a95-4f71-9974-a56b0f2601df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:15.662732 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-33c71af5-1a95-4f71-9974-a56b0f2601df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:15.809778 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2940ee83-d9a7-4cca-b63e-9b6f33a64b40 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:15.810949 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2940ee83-d9a7-4cca-b63e-9b6f33a64b40 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:15.820971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2940ee83-d9a7-4cca-b63e-9b6f33a64b40 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:15.821483 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2940ee83-d9a7-4cca-b63e-9b6f33a64b40 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:15.823855 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2940ee83-d9a7-4cca-b63e-9b6f33a64b40 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:15.824512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2940ee83-d9a7-4cca-b63e-9b6f33a64b40 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:15.930560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-33c71af5-1a95-4f71-9974-a56b0f2601df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:15.942400 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-33c71af5-1a95-4f71-9974-a56b0f2601df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.317386 Apr 14 16:13:15.943347 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 185/373] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:15 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:15.948420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8b29cec1-6e0c-45bf-a4a4-bd4ad02c85aa tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:15.949291 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8b29cec1-6e0c-45bf-a4a4-bd4ad02c85aa tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:15.957230 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8b29cec1-6e0c-45bf-a4a4-bd4ad02c85aa tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:15.957716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8b29cec1-6e0c-45bf-a4a4-bd4ad02c85aa tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:15.958739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8b29cec1-6e0c-45bf-a4a4-bd4ad02c85aa tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:15.959384 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8b29cec1-6e0c-45bf-a4a4-bd4ad02c85aa tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:15.999553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2940ee83-d9a7-4cca-b63e-9b6f33a64b40 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 29590 microversion: 2.1 time: 0.192950 Apr 14 16:13:15.999553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 189/374] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:15 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 29590 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:16.109094 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0020f676-e004-403e-9830-f8107180ea1c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:16.109276 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8b29cec1-6e0c-45bf-a4a4-bd4ad02c85aa tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:16.110226 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0020f676-e004-403e-9830-f8107180ea1c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:16.119262 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8b29cec1-6e0c-45bf-a4a4-bd4ad02c85aa tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1270 microversion: 2.1 time: 0.174472 Apr 14 16:13:16.120118 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 186/375] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:15 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:16.135581 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0020f676-e004-403e-9830-f8107180ea1c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:16.136096 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0020f676-e004-403e-9830-f8107180ea1c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:16.137135 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0020f676-e004-403e-9830-f8107180ea1c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:16.137832 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0020f676-e004-403e-9830-f8107180ea1c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:16.270390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0020f676-e004-403e-9830-f8107180ea1c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 36022 microversion: 2.20 time: 0.165735 Apr 14 16:13:16.275055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 190/376] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:16 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 36022 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:16.961155 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c9a23944-11ec-4874-9821-ee3c79ab6fd4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:16.962521 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c9a23944-11ec-4874-9821-ee3c79ab6fd4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:16.973350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9a23944-11ec-4874-9821-ee3c79ab6fd4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:16.974097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9a23944-11ec-4874-9821-ee3c79ab6fd4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:16.975149 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9a23944-11ec-4874-9821-ee3c79ab6fd4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:16.975836 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9a23944-11ec-4874-9821-ee3c79ab6fd4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:17.012441 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c72f2720-4297-4568-bd7b-0e1fd7133ed7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:17.013585 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c72f2720-4297-4568-bd7b-0e1fd7133ed7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:17.033716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c72f2720-4297-4568-bd7b-0e1fd7133ed7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:17.034578 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c72f2720-4297-4568-bd7b-0e1fd7133ed7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:17.035783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c72f2720-4297-4568-bd7b-0e1fd7133ed7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:17.036469 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c72f2720-4297-4568-bd7b-0e1fd7133ed7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:17.195637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c72f2720-4297-4568-bd7b-0e1fd7133ed7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 30382 microversion: 2.1 time: 0.187595 Apr 14 16:13:17.197172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 191/377] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:17 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 30382 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:17.203620 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2b22dcf2-f186-49a8-98c6-94f09c62ab97 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:17.204884 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2b22dcf2-f186-49a8-98c6-94f09c62ab97 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:17.216384 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2b22dcf2-f186-49a8-98c6-94f09c62ab97 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:17.217176 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2b22dcf2-f186-49a8-98c6-94f09c62ab97 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:17.218547 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2b22dcf2-f186-49a8-98c6-94f09c62ab97 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:17.219266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2b22dcf2-f186-49a8-98c6-94f09c62ab97 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:17.409442 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2b22dcf2-f186-49a8-98c6-94f09c62ab97 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:17.422020 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2b22dcf2-f186-49a8-98c6-94f09c62ab97 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1276 microversion: 2.1 time: 0.222671 Apr 14 16:13:17.422199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 192/378] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:17 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1276 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:17.433283 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1fcc8953-1193-4ecc-92f0-05406a36eea9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:17.438951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1fcc8953-1193-4ecc-92f0-05406a36eea9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:17.448837 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1fcc8953-1193-4ecc-92f0-05406a36eea9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:17.449650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1fcc8953-1193-4ecc-92f0-05406a36eea9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:17.450609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1fcc8953-1193-4ecc-92f0-05406a36eea9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:17.451209 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1fcc8953-1193-4ecc-92f0-05406a36eea9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:17.572584 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c9a23944-11ec-4874-9821-ee3c79ab6fd4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:17.583960 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c9a23944-11ec-4874-9821-ee3c79ab6fd4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.627664 Apr 14 16:13:17.584842 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 187/379] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:16 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:17.662423 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1fcc8953-1193-4ecc-92f0-05406a36eea9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 36561 microversion: 2.20 time: 0.237913 Apr 14 16:13:17.666891 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 193/380] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:17 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 36561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:18.209173 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0ae4edea-883d-4606-90cf-267ce25ff8e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:18.210496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0ae4edea-883d-4606-90cf-267ce25ff8e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:18.220362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0ae4edea-883d-4606-90cf-267ce25ff8e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:18.220857 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0ae4edea-883d-4606-90cf-267ce25ff8e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:18.221921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0ae4edea-883d-4606-90cf-267ce25ff8e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:18.222677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0ae4edea-883d-4606-90cf-267ce25ff8e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:18.440902 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3216c0d2-e33f-406a-a2e8-e4acaf2ba981 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:18.442559 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3216c0d2-e33f-406a-a2e8-e4acaf2ba981 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:18.452169 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3216c0d2-e33f-406a-a2e8-e4acaf2ba981 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:18.453000 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3216c0d2-e33f-406a-a2e8-e4acaf2ba981 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:18.454104 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3216c0d2-e33f-406a-a2e8-e4acaf2ba981 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:18.454764 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3216c0d2-e33f-406a-a2e8-e4acaf2ba981 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:18.910435 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3216c0d2-e33f-406a-a2e8-e4acaf2ba981 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:18.924338 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3216c0d2-e33f-406a-a2e8-e4acaf2ba981 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1318 microversion: 2.1 time: 0.487944 Apr 14 16:13:18.925728 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 194/381] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:18 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:18.939555 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7ab84f64-8310-4dd2-8362-3d8fa51a14ae tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:18.940777 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7ab84f64-8310-4dd2-8362-3d8fa51a14ae tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:18.949252 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7ab84f64-8310-4dd2-8362-3d8fa51a14ae tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:18.949768 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7ab84f64-8310-4dd2-8362-3d8fa51a14ae tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:18.952205 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7ab84f64-8310-4dd2-8362-3d8fa51a14ae tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:18.952712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7ab84f64-8310-4dd2-8362-3d8fa51a14ae tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:19.374642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7ab84f64-8310-4dd2-8362-3d8fa51a14ae tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:19.390558 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7ab84f64-8310-4dd2-8362-3d8fa51a14ae tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.461562 Apr 14 16:13:19.391880 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 195/382] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:18 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:19.399116 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-376ee9b2-fcba-4834-8237-270363693ff9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:19.401614 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-376ee9b2-fcba-4834-8237-270363693ff9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:19.414666 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-376ee9b2-fcba-4834-8237-270363693ff9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:19.415685 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-376ee9b2-fcba-4834-8237-270363693ff9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:19.417297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-376ee9b2-fcba-4834-8237-270363693ff9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:19.419159 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-376ee9b2-fcba-4834-8237-270363693ff9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:20.804918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0ae4edea-883d-4606-90cf-267ce25ff8e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 31949 microversion: 2.1 time: 2.600290 Apr 14 16:13:20.807540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 188/383] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:18 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 31949 bytes in 2603 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:20.815590 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-c0a6924d-504a-4cd0-8776-aa4e8a7758d5 req-ea7151b9-7737-4464-b001-1be6e2c9ea1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "304001e9-ca53-4ab3-be25-483e56e3b857", "tag": "e07ec31c-d9ac-4532-b2dd-5c2caeafaf57"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:20.817533 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:13:20.817533 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:13:20.828985 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-c0a6924d-504a-4cd0-8776-aa4e8a7758d5 req-ea7151b9-7737-4464-b001-1be6e2c9ea1a service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:20.829642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-c0a6924d-504a-4cd0-8776-aa4e8a7758d5 req-ea7151b9-7737-4464-b001-1be6e2c9ea1a service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:20.847719 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-c0a6924d-504a-4cd0-8776-aa4e8a7758d5 req-ea7151b9-7737-4464-b001-1be6e2c9ea1a service nova] Creating event network-changed:e07ec31c-d9ac-4532-b2dd-5c2caeafaf57 for instance 304001e9-ca53-4ab3-be25-483e56e3b857 on hv-cinder-78626 Apr 14 16:13:20.853673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-c0a6924d-504a-4cd0-8776-aa4e8a7758d5 req-ea7151b9-7737-4464-b001-1be6e2c9ea1a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045589 Apr 14 16:13:20.854555 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 189/384] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:13:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:13:20.860791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-08b6d024-ceaf-4334-a61d-10ab5fdd0a89 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:20.861592 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-08b6d024-ceaf-4334-a61d-10ab5fdd0a89 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:20.869717 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-08b6d024-ceaf-4334-a61d-10ab5fdd0a89 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:20.870499 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-08b6d024-ceaf-4334-a61d-10ab5fdd0a89 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:20.872388 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-08b6d024-ceaf-4334-a61d-10ab5fdd0a89 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:20.873301 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-08b6d024-ceaf-4334-a61d-10ab5fdd0a89 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:21.186171 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-08b6d024-ceaf-4334-a61d-10ab5fdd0a89 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:21.196304 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-08b6d024-ceaf-4334-a61d-10ab5fdd0a89 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1318 microversion: 2.1 time: 0.340657 Apr 14 16:13:21.203914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 190/385] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:20 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:21.212299 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9eecd23f-ff0a-476c-8183-eac44731fe79 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:21.212976 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9eecd23f-ff0a-476c-8183-eac44731fe79 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:21.237835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9eecd23f-ff0a-476c-8183-eac44731fe79 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:21.238349 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9eecd23f-ff0a-476c-8183-eac44731fe79 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:21.239207 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9eecd23f-ff0a-476c-8183-eac44731fe79 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:21.239697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9eecd23f-ff0a-476c-8183-eac44731fe79 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:21.641765 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9eecd23f-ff0a-476c-8183-eac44731fe79 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:21.662209 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9eecd23f-ff0a-476c-8183-eac44731fe79 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.459441 Apr 14 16:13:21.672532 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 191/386] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:21 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:21.820085 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fecec889-ddfc-4f92-983e-5f258d6b08e6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:21.822061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fecec889-ddfc-4f92-983e-5f258d6b08e6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:21.846234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fecec889-ddfc-4f92-983e-5f258d6b08e6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:21.848730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fecec889-ddfc-4f92-983e-5f258d6b08e6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:21.857247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fecec889-ddfc-4f92-983e-5f258d6b08e6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:21.857247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fecec889-ddfc-4f92-983e-5f258d6b08e6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:22.274675 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-376ee9b2-fcba-4834-8237-270363693ff9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 38297 microversion: 2.20 time: 2.879949 Apr 14 16:13:22.279704 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 196/387] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:19 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 38297 bytes in 2882 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:22.282116 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a5e4f49a-09b5-4acd-8d49-230eef1700dc tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:22.282883 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a5e4f49a-09b5-4acd-8d49-230eef1700dc tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:22.293562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fecec889-ddfc-4f92-983e-5f258d6b08e6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 33242 microversion: 2.1 time: 0.477282 Apr 14 16:13:22.298327 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 192/388] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:21 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 33242 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:13:22.304365 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5e4f49a-09b5-4acd-8d49-230eef1700dc tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:22.304887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5e4f49a-09b5-4acd-8d49-230eef1700dc tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:22.314207 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5e4f49a-09b5-4acd-8d49-230eef1700dc tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:22.315193 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5e4f49a-09b5-4acd-8d49-230eef1700dc tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:22.681536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f0728d03-eaa8-4d91-91c1-0ffa20b4692a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:22.682565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f0728d03-eaa8-4d91-91c1-0ffa20b4692a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:22.701983 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f0728d03-eaa8-4d91-91c1-0ffa20b4692a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:22.702773 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f0728d03-eaa8-4d91-91c1-0ffa20b4692a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:22.708692 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f0728d03-eaa8-4d91-91c1-0ffa20b4692a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:22.709278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f0728d03-eaa8-4d91-91c1-0ffa20b4692a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:23.023000 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a5e4f49a-09b5-4acd-8d49-230eef1700dc tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:23.052195 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a5e4f49a-09b5-4acd-8d49-230eef1700dc tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1318 microversion: 2.1 time: 0.774915 Apr 14 16:13:23.063842 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 197/389] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:22 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1318 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:23.292172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cc670bdd-7a0b-4a79-9d09-8eca5f8c94be tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:23.293834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cc670bdd-7a0b-4a79-9d09-8eca5f8c94be tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:23.302502 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f0728d03-eaa8-4d91-91c1-0ffa20b4692a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:23.314120 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f0728d03-eaa8-4d91-91c1-0ffa20b4692a tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.637526 Apr 14 16:13:23.329359 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 193/390] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:22 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:13:23.341351 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c665bb9e-35c1-40d0-bff0-3184550a0962 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:23.344197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cc670bdd-7a0b-4a79-9d09-8eca5f8c94be tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:23.344710 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cc670bdd-7a0b-4a79-9d09-8eca5f8c94be tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:23.345606 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cc670bdd-7a0b-4a79-9d09-8eca5f8c94be tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:23.346107 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cc670bdd-7a0b-4a79-9d09-8eca5f8c94be tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:23.349927 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c665bb9e-35c1-40d0-bff0-3184550a0962 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:23.375312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c665bb9e-35c1-40d0-bff0-3184550a0962 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:23.375833 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c665bb9e-35c1-40d0-bff0-3184550a0962 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:23.376723 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c665bb9e-35c1-40d0-bff0-3184550a0962 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:23.377268 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c665bb9e-35c1-40d0-bff0-3184550a0962 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:23.670702 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cc670bdd-7a0b-4a79-9d09-8eca5f8c94be tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 38367 microversion: 2.20 time: 0.384292 Apr 14 16:13:23.672176 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 198/391] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:23 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 38367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:23.681162 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c665bb9e-35c1-40d0-bff0-3184550a0962 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 33681 microversion: 2.1 time: 0.350213 Apr 14 16:13:23.681892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 194/392] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:23 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 33681 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:24.071953 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-13880a3e-f5c6-4258-9c1f-81ac7a9152c6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:24.072730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-13880a3e-f5c6-4258-9c1f-81ac7a9152c6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:24.116395 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-13880a3e-f5c6-4258-9c1f-81ac7a9152c6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:24.119300 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-13880a3e-f5c6-4258-9c1f-81ac7a9152c6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:24.120290 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-13880a3e-f5c6-4258-9c1f-81ac7a9152c6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:24.124739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-13880a3e-f5c6-4258-9c1f-81ac7a9152c6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:24.333720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8ab21f5f-d7c9-41c7-91f5-d5dbfbd8f8b5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:24.334637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8ab21f5f-d7c9-41c7-91f5-d5dbfbd8f8b5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:24.365329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8ab21f5f-d7c9-41c7-91f5-d5dbfbd8f8b5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:24.365329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8ab21f5f-d7c9-41c7-91f5-d5dbfbd8f8b5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:24.365329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8ab21f5f-d7c9-41c7-91f5-d5dbfbd8f8b5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:24.365818 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8ab21f5f-d7c9-41c7-91f5-d5dbfbd8f8b5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:25.211403 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8ab21f5f-d7c9-41c7-91f5-d5dbfbd8f8b5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:25.215808 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-13880a3e-f5c6-4258-9c1f-81ac7a9152c6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:25.226967 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8ab21f5f-d7c9-41c7-91f5-d5dbfbd8f8b5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.898506 Apr 14 16:13:25.227951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-13880a3e-f5c6-4258-9c1f-81ac7a9152c6 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1318 microversion: 2.1 time: 1.159803 Apr 14 16:13:25.229222 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 199/393] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:24 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1318 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:25.235089 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c5aa4d9a-950e-49ed-9d79-1174330cc494 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:25.235895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 195/394] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:24 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:25.236902 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c5aa4d9a-950e-49ed-9d79-1174330cc494 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:25.253471 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f62d14a1-67dc-4782-8e58-d5a5cb9ae2d0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:25.256063 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f62d14a1-67dc-4782-8e58-d5a5cb9ae2d0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:25.267163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f62d14a1-67dc-4782-8e58-d5a5cb9ae2d0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:25.267673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f62d14a1-67dc-4782-8e58-d5a5cb9ae2d0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:25.268583 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f62d14a1-67dc-4782-8e58-d5a5cb9ae2d0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:25.268999 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f62d14a1-67dc-4782-8e58-d5a5cb9ae2d0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:25.271393 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5aa4d9a-950e-49ed-9d79-1174330cc494 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:25.284213 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5aa4d9a-950e-49ed-9d79-1174330cc494 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:25.285469 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5aa4d9a-950e-49ed-9d79-1174330cc494 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:25.286239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5aa4d9a-950e-49ed-9d79-1174330cc494 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:25.446120 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f62d14a1-67dc-4782-8e58-d5a5cb9ae2d0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 34256 microversion: 2.1 time: 0.207629 Apr 14 16:13:25.447703 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 196/395] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:25 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 34256 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:25.458227 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c5aa4d9a-950e-49ed-9d79-1174330cc494 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 38371 microversion: 2.20 time: 0.227439 Apr 14 16:13:25.459862 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 200/396] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:25 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 38371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:25.522189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b7f3296b-dcac-4ff8-8b4e-ddd5cca46222 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:25.522973 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b7f3296b-dcac-4ff8-8b4e-ddd5cca46222 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:25.531727 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b7f3296b-dcac-4ff8-8b4e-ddd5cca46222 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:25.532239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b7f3296b-dcac-4ff8-8b4e-ddd5cca46222 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:25.533375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b7f3296b-dcac-4ff8-8b4e-ddd5cca46222 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:25.533871 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b7f3296b-dcac-4ff8-8b4e-ddd5cca46222 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:25.885394 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b7f3296b-dcac-4ff8-8b4e-ddd5cca46222 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:25.896605 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b7f3296b-dcac-4ff8-8b4e-ddd5cca46222 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1594 microversion: 2.1 time: 0.378870 Apr 14 16:13:25.897317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 197/397] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:25 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1594 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:26.250031 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-27eee2dd-f3ef-4d20-b87a-80457f2a5fbf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:26.255903 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-24549f48-1369-4e07-b7ef-3e86c316f59d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:26.257278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-24549f48-1369-4e07-b7ef-3e86c316f59d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:26.260370 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-27eee2dd-f3ef-4d20-b87a-80457f2a5fbf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:26.274837 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-24549f48-1369-4e07-b7ef-3e86c316f59d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:26.275345 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-24549f48-1369-4e07-b7ef-3e86c316f59d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:26.276213 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-24549f48-1369-4e07-b7ef-3e86c316f59d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:26.276707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-24549f48-1369-4e07-b7ef-3e86c316f59d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:26.284803 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-27eee2dd-f3ef-4d20-b87a-80457f2a5fbf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:26.287854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-27eee2dd-f3ef-4d20-b87a-80457f2a5fbf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:26.291172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-27eee2dd-f3ef-4d20-b87a-80457f2a5fbf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:26.291670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-27eee2dd-f3ef-4d20-b87a-80457f2a5fbf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:26.708288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-24549f48-1369-4e07-b7ef-3e86c316f59d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:26.721138 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-24549f48-1369-4e07-b7ef-3e86c316f59d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.468297 Apr 14 16:13:26.722968 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 198/398] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:26 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:26.729562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8f7bcf51-50dc-4b8c-ace6-f4ad0623351c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:26.732355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8f7bcf51-50dc-4b8c-ace6-f4ad0623351c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:26.736058 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-27eee2dd-f3ef-4d20-b87a-80457f2a5fbf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:26.743560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f7bcf51-50dc-4b8c-ace6-f4ad0623351c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:26.744305 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f7bcf51-50dc-4b8c-ace6-f4ad0623351c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:26.745582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f7bcf51-50dc-4b8c-ace6-f4ad0623351c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:26.746576 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f7bcf51-50dc-4b8c-ace6-f4ad0623351c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:26.748153 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-27eee2dd-f3ef-4d20-b87a-80457f2a5fbf tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1318 microversion: 2.1 time: 0.503863 Apr 14 16:13:26.754825 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 201/399] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:26 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:26.763438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-39ddb43e-3465-40f8-80c0-483c283f7fbd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:26.765626 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-39ddb43e-3465-40f8-80c0-483c283f7fbd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:26.777956 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-39ddb43e-3465-40f8-80c0-483c283f7fbd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:26.778685 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-39ddb43e-3465-40f8-80c0-483c283f7fbd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:26.779953 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-39ddb43e-3465-40f8-80c0-483c283f7fbd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:26.780600 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-39ddb43e-3465-40f8-80c0-483c283f7fbd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:26.918990 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8f7bcf51-50dc-4b8c-ace6-f4ad0623351c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 34753 microversion: 2.1 time: 0.194297 Apr 14 16:13:26.920864 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 199/400] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:26 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 34753 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:26.950922 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-39ddb43e-3465-40f8-80c0-483c283f7fbd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 200 len: 38507 microversion: 2.20 time: 0.194134 Apr 14 16:13:26.957619 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 202/401] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:26 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 38507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:26.967362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-70fc0edc-c077-4a1c-9e98-b8e6fcf19afb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:26.968009 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-70fc0edc-c077-4a1c-9e98-b8e6fcf19afb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:26.980310 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70fc0edc-c077-4a1c-9e98-b8e6fcf19afb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:26.980814 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70fc0edc-c077-4a1c-9e98-b8e6fcf19afb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:26.981714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70fc0edc-c077-4a1c-9e98-b8e6fcf19afb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:26.982203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70fc0edc-c077-4a1c-9e98-b8e6fcf19afb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:27.053864 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-70fc0edc-c077-4a1c-9e98-b8e6fcf19afb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/ips" status: 200 len: 152 microversion: 2.20 time: 0.094398 Apr 14 16:13:27.054805 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 203/402] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Apr 14 16:13:26 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/ips => generated 152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:13:27.208083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-609b356d-9b58-42de-952e-d9e538cbc98b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Action: 'create', calling method: .version_select at 0x7ff58efdb400>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-643900673"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:27.233888 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-609b356d-9b58-42de-952e-d9e538cbc98b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Getting quotas for project ed9d2e253f144da0bf1bbc63b4657b81. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:13:27.244890 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-609b356d-9b58-42de-952e-d9e538cbc98b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Getting quotas for user c9637a87d0cc41bb87b2437326c01992 and project ed9d2e253f144da0bf1bbc63b4657b81. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:13:27.740873 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-26c2db26-c4cb-41c9-8214-d943ab1f5b67 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:27.741594 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-26c2db26-c4cb-41c9-8214-d943ab1f5b67 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:27.748541 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-609b356d-9b58-42de-952e-d9e538cbc98b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Getting quotas for project ed9d2e253f144da0bf1bbc63b4657b81. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:13:27.753371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-609b356d-9b58-42de-952e-d9e538cbc98b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Getting quotas for user c9637a87d0cc41bb87b2437326c01992 and project ed9d2e253f144da0bf1bbc63b4657b81. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:13:27.760792 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26c2db26-c4cb-41c9-8214-d943ab1f5b67 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:27.761374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26c2db26-c4cb-41c9-8214-d943ab1f5b67 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:27.762954 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26c2db26-c4cb-41c9-8214-d943ab1f5b67 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:27.763455 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26c2db26-c4cb-41c9-8214-d943ab1f5b67 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:27.772384 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-609b356d-9b58-42de-952e-d9e538cbc98b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.850158 Apr 14 16:13:27.773545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 200/403] 10.222.0.60 () {60 vars in 1148 bytes} [Wed Apr 14 16:13:26 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:27.779793 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-acedf5cd-cfed-4002-a235-1079c0f84de7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:27.780857 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-acedf5cd-cfed-4002-a235-1079c0f84de7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:27.799246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-acedf5cd-cfed-4002-a235-1079c0f84de7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:27.799996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-acedf5cd-cfed-4002-a235-1079c0f84de7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:27.801254 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-acedf5cd-cfed-4002-a235-1079c0f84de7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:27.802111 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-acedf5cd-cfed-4002-a235-1079c0f84de7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:28.127019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-26c2db26-c4cb-41c9-8214-d943ab1f5b67 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:28.155076 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-26c2db26-c4cb-41c9-8214-d943ab1f5b67 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.418102 Apr 14 16:13:28.155740 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 204/404] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:27 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:28.162478 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c0091649-1611-456e-b5fb-f9f6fa0d54f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:28.163522 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c0091649-1611-456e-b5fb-f9f6fa0d54f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:28.195099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0091649-1611-456e-b5fb-f9f6fa0d54f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:28.195629 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0091649-1611-456e-b5fb-f9f6fa0d54f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:28.196679 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0091649-1611-456e-b5fb-f9f6fa0d54f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:28.196944 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0091649-1611-456e-b5fb-f9f6fa0d54f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:28.272219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-acedf5cd-cfed-4002-a235-1079c0f84de7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:28.284606 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-acedf5cd-cfed-4002-a235-1079c0f84de7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1318 microversion: 2.1 time: 0.509632 Apr 14 16:13:28.296112 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 201/405] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:27 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:28.384116 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c0091649-1611-456e-b5fb-f9f6fa0d54f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 35197 microversion: 2.1 time: 0.226938 Apr 14 16:13:28.385099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 205/406] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:28 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 35197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:29.176134 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d8f62abd-22d5-416a-af98-26a7b5cbc797 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:29.177534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d8f62abd-22d5-416a-af98-26a7b5cbc797 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:29.231706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d8f62abd-22d5-416a-af98-26a7b5cbc797 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:29.239559 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d8f62abd-22d5-416a-af98-26a7b5cbc797 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:29.242148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d8f62abd-22d5-416a-af98-26a7b5cbc797 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:29.242652 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d8f62abd-22d5-416a-af98-26a7b5cbc797 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:29.304010 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a22ae8cd-fbe0-48f3-a3e4-bf1a44a5cc05 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:29.304789 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a22ae8cd-fbe0-48f3-a3e4-bf1a44a5cc05 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:29.319882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a22ae8cd-fbe0-48f3-a3e4-bf1a44a5cc05 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:29.326121 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a22ae8cd-fbe0-48f3-a3e4-bf1a44a5cc05 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:29.329392 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a22ae8cd-fbe0-48f3-a3e4-bf1a44a5cc05 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:29.330062 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a22ae8cd-fbe0-48f3-a3e4-bf1a44a5cc05 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:29.692772 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d8f62abd-22d5-416a-af98-26a7b5cbc797 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:29.715344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d8f62abd-22d5-416a-af98-26a7b5cbc797 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.544273 Apr 14 16:13:29.719515 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 202/407] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:29 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:29.727581 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-61754855-f9ed-452e-a776-9899a7aa1b11 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:29.738044 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-61754855-f9ed-452e-a776-9899a7aa1b11 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:29.760438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-61754855-f9ed-452e-a776-9899a7aa1b11 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:29.765707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-61754855-f9ed-452e-a776-9899a7aa1b11 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:29.766978 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-61754855-f9ed-452e-a776-9899a7aa1b11 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:29.767689 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-61754855-f9ed-452e-a776-9899a7aa1b11 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:29.929571 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a22ae8cd-fbe0-48f3-a3e4-bf1a44a5cc05 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:29.948811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a22ae8cd-fbe0-48f3-a3e4-bf1a44a5cc05 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1318 microversion: 2.1 time: 0.649098 Apr 14 16:13:29.950988 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-61754855-f9ed-452e-a776-9899a7aa1b11 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 35789 microversion: 2.1 time: 0.227638 Apr 14 16:13:29.952543 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 203/408] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:29 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 35789 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:29.962680 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 206/409] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:29 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1318 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:29.967383 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bbea7961-7053-44c0-96f4-beebf136ea3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:29.969565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bbea7961-7053-44c0-96f4-beebf136ea3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:29.989385 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bbea7961-7053-44c0-96f4-beebf136ea3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:29.993447 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bbea7961-7053-44c0-96f4-beebf136ea3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:29.994941 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bbea7961-7053-44c0-96f4-beebf136ea3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:29.995890 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bbea7961-7053-44c0-96f4-beebf136ea3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:30.078500 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-bbea7961-7053-44c0-96f4-beebf136ea3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lazy-loading 'flavor' on Instance uuid 97e83f61-2715-436f-8d7c-88c4483cc0e5 {{(pid=99335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:13:30.665622 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-945583d5-690a-429c-b43c-13d84d169064 req-9337e6e8-d649-4cac-aed4-8a369a2a202e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93346a14-b6f5-4d77-a1a7-f4d649c7ccd5", "tag": "3a58c362-2e99-4559-9977-3b635ab88161"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:30.667344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:13:30.667344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:13:30.711955 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-945583d5-690a-429c-b43c-13d84d169064 req-9337e6e8-d649-4cac-aed4-8a369a2a202e service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:30.717105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-945583d5-690a-429c-b43c-13d84d169064 req-9337e6e8-d649-4cac-aed4-8a369a2a202e service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:30.736382 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bbea7961-7053-44c0-96f4-beebf136ea3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 202 len: 0 microversion: 2.20 time: 0.776108 Apr 14 16:13:30.742328 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 204/410] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:13:29 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 0 bytes in 780 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:13:30.767091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-08a943fa-ff21-43bb-8d60-73383f7eae35 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:30.768949 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-08a943fa-ff21-43bb-8d60-73383f7eae35 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:30.805480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-945583d5-690a-429c-b43c-13d84d169064 req-9337e6e8-d649-4cac-aed4-8a369a2a202e service nova] Creating event network-changed:3a58c362-2e99-4559-9977-3b635ab88161 for instance 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 on hv-cinder-78626 Apr 14 16:13:30.807466 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-08a943fa-ff21-43bb-8d60-73383f7eae35 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:30.809865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-08a943fa-ff21-43bb-8d60-73383f7eae35 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:30.812934 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-08a943fa-ff21-43bb-8d60-73383f7eae35 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:30.814822 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-08a943fa-ff21-43bb-8d60-73383f7eae35 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:30.821105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-945583d5-690a-429c-b43c-13d84d169064 req-9337e6e8-d649-4cac-aed4-8a369a2a202e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159308 Apr 14 16:13:30.824865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 207/411] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:13:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:13:30.841896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fb312d89-676f-499f-ad21-2fb472eabdba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:30.844931 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fb312d89-676f-499f-ad21-2fb472eabdba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:30.878448 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb312d89-676f-499f-ad21-2fb472eabdba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:30.878962 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb312d89-676f-499f-ad21-2fb472eabdba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:30.879839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb312d89-676f-499f-ad21-2fb472eabdba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:30.880335 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb312d89-676f-499f-ad21-2fb472eabdba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:31.273635 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-08a943fa-ff21-43bb-8d60-73383f7eae35 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:31.286478 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-08a943fa-ff21-43bb-8d60-73383f7eae35 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.538267 Apr 14 16:13:31.287423 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 205/412] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:30 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:31.303069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-951c51be-13a1-4ae8-bb2a-c860632dda6c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:31.304452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-951c51be-13a1-4ae8-bb2a-c860632dda6c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:31.314085 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-951c51be-13a1-4ae8-bb2a-c860632dda6c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:31.314897 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-951c51be-13a1-4ae8-bb2a-c860632dda6c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:31.316058 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-951c51be-13a1-4ae8-bb2a-c860632dda6c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:31.326840 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-951c51be-13a1-4ae8-bb2a-c860632dda6c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:31.550360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fb312d89-676f-499f-ad21-2fb472eabdba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:31.565736 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fb312d89-676f-499f-ad21-2fb472eabdba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:31.565980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-951c51be-13a1-4ae8-bb2a-c860632dda6c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 36512 microversion: 2.1 time: 0.276182 Apr 14 16:13:31.567180 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 206/413] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:31 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 36512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:31.569954 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fb312d89-676f-499f-ad21-2fb472eabdba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:31.571239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fb312d89-676f-499f-ad21-2fb472eabdba tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.742340 Apr 14 16:13:31.581822 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cd637b6e-7209-4e80-86bd-c1f02a0be49d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:31.582715 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cd637b6e-7209-4e80-86bd-c1f02a0be49d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:31.592763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 208/414] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:30 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:31.594200 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd637b6e-7209-4e80-86bd-c1f02a0be49d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:31.594722 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd637b6e-7209-4e80-86bd-c1f02a0be49d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:31.597766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd637b6e-7209-4e80-86bd-c1f02a0be49d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:31.598354 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd637b6e-7209-4e80-86bd-c1f02a0be49d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:31.983190 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cd637b6e-7209-4e80-86bd-c1f02a0be49d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:32.000719 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cd637b6e-7209-4e80-86bd-c1f02a0be49d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1318 microversion: 2.1 time: 0.431040 Apr 14 16:13:32.001762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 207/415] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:31 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:32.308122 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d72ec668-7646-47e4-a8e5-7a4be130c3bc tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:32.309569 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d72ec668-7646-47e4-a8e5-7a4be130c3bc tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:32.325217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d72ec668-7646-47e4-a8e5-7a4be130c3bc tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:32.328128 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d72ec668-7646-47e4-a8e5-7a4be130c3bc tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:32.329030 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d72ec668-7646-47e4-a8e5-7a4be130c3bc tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:32.329562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d72ec668-7646-47e4-a8e5-7a4be130c3bc tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:32.585057 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2611d932-c86d-4f7e-8dcf-a0507e30fd98 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:32.588646 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2611d932-c86d-4f7e-8dcf-a0507e30fd98 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:32.603307 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2611d932-c86d-4f7e-8dcf-a0507e30fd98 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:32.610950 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2611d932-c86d-4f7e-8dcf-a0507e30fd98 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:32.618423 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2611d932-c86d-4f7e-8dcf-a0507e30fd98 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:32.619797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2611d932-c86d-4f7e-8dcf-a0507e30fd98 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:32.762036 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d72ec668-7646-47e4-a8e5-7a4be130c3bc tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:32.790284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d72ec668-7646-47e4-a8e5-7a4be130c3bc tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.485760 Apr 14 16:13:32.791477 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 209/416] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:32 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:32.803142 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d1f63930-ed97-4b54-bcc9-e3451fe4b306 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:32.804098 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d1f63930-ed97-4b54-bcc9-e3451fe4b306 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:32.814411 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d1f63930-ed97-4b54-bcc9-e3451fe4b306 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:32.815925 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d1f63930-ed97-4b54-bcc9-e3451fe4b306 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:32.817228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d1f63930-ed97-4b54-bcc9-e3451fe4b306 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:32.817913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d1f63930-ed97-4b54-bcc9-e3451fe4b306 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:32.880901 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2611d932-c86d-4f7e-8dcf-a0507e30fd98 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 37097 microversion: 2.1 time: 0.299591 Apr 14 16:13:32.885412 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 208/417] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:32 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 37097 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:32.888536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-6d5c7172-31dc-4aea-998d-ac96b41ec837 req-3c2b13ca-cd70-4961-a3f4-4190ee17c147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304001e9-ca53-4ab3-be25-483e56e3b857", "name": "network-vif-plugged", "status": "completed", "tag": "e07ec31c-d9ac-4532-b2dd-5c2caeafaf57"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:32.890397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:13:32.890397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:13:32.901886 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-6d5c7172-31dc-4aea-998d-ac96b41ec837 req-3c2b13ca-cd70-4961-a3f4-4190ee17c147 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:32.902560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-6d5c7172-31dc-4aea-998d-ac96b41ec837 req-3c2b13ca-cd70-4961-a3f4-4190ee17c147 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:32.930828 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-6d5c7172-31dc-4aea-998d-ac96b41ec837 req-3c2b13ca-cd70-4961-a3f4-4190ee17c147 service nova] Creating event network-vif-plugged:e07ec31c-d9ac-4532-b2dd-5c2caeafaf57 for instance 304001e9-ca53-4ab3-be25-483e56e3b857 on hv-cinder-78626 Apr 14 16:13:32.943065 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-6d5c7172-31dc-4aea-998d-ac96b41ec837 req-3c2b13ca-cd70-4961-a3f4-4190ee17c147 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058979 Apr 14 16:13:32.944478 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 209/418] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:13:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:13:33.023046 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a9ec44a1-5f70-497b-8541-1256e065711f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:33.024447 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a9ec44a1-5f70-497b-8541-1256e065711f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:33.033863 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a9ec44a1-5f70-497b-8541-1256e065711f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:33.034195 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a9ec44a1-5f70-497b-8541-1256e065711f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:33.035047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a9ec44a1-5f70-497b-8541-1256e065711f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:33.035540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a9ec44a1-5f70-497b-8541-1256e065711f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:33.327768 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d1f63930-ed97-4b54-bcc9-e3451fe4b306 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:33.349914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d1f63930-ed97-4b54-bcc9-e3451fe4b306 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:33.351329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d1f63930-ed97-4b54-bcc9-e3451fe4b306 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:33.352651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d1f63930-ed97-4b54-bcc9-e3451fe4b306 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.559772 Apr 14 16:13:33.353342 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 210/419] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:32 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:33.483223 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a9ec44a1-5f70-497b-8541-1256e065711f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:33.502872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a9ec44a1-5f70-497b-8541-1256e065711f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1318 microversion: 2.1 time: 0.486285 Apr 14 16:13:33.503379 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 210/420] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:33 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:33.777756 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a0be84cc-6c43-4dd7-a272-6ce014e4e3d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-307888182"}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:33.781349 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a0be84cc-6c43-4dd7-a272-6ce014e4e3d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:33.791449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0be84cc-6c43-4dd7-a272-6ce014e4e3d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:33.791949 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0be84cc-6c43-4dd7-a272-6ce014e4e3d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:33.793462 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0be84cc-6c43-4dd7-a272-6ce014e4e3d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:33.794003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0be84cc-6c43-4dd7-a272-6ce014e4e3d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:33.809067 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-92e74311-bacf-45b4-8093-cdb69040719f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:33.809972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-92e74311-bacf-45b4-8093-cdb69040719f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:33.818045 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-92e74311-bacf-45b4-8093-cdb69040719f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:33.818539 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-92e74311-bacf-45b4-8093-cdb69040719f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:33.819582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-92e74311-bacf-45b4-8093-cdb69040719f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:33.820084 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-92e74311-bacf-45b4-8093-cdb69040719f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:34.044650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.network.security_group_api [None req-a0be84cc-6c43-4dd7-a272-6ce014e4e3d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Adding security group e471750e-8a1e-40c7-af46-00e29ce14023 to port 3a58c362-2e99-4559-9977-3b635ab88161 Apr 14 16:13:34.084521 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-92e74311-bacf-45b4-8093-cdb69040719f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:34.097346 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-92e74311-bacf-45b4-8093-cdb69040719f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.293198 Apr 14 16:13:34.098680 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 211/421] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:33 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:34.104139 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-db68ab7c-cc0e-44fd-8543-189f4a501db1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:34.105507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-db68ab7c-cc0e-44fd-8543-189f4a501db1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:34.123569 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-db68ab7c-cc0e-44fd-8543-189f4a501db1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:34.124416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-db68ab7c-cc0e-44fd-8543-189f4a501db1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:34.125663 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-db68ab7c-cc0e-44fd-8543-189f4a501db1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:34.126375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-db68ab7c-cc0e-44fd-8543-189f4a501db1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:34.298776 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-db68ab7c-cc0e-44fd-8543-189f4a501db1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 37618 microversion: 2.1 time: 0.198274 Apr 14 16:13:34.299810 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 212/422] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:34 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 37618 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:34.375835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cbe5a408-1e30-4ea0-ad01-4fb3ba08cadf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:34.376821 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cbe5a408-1e30-4ea0-ad01-4fb3ba08cadf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:34.387420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbe5a408-1e30-4ea0-ad01-4fb3ba08cadf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:34.388198 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbe5a408-1e30-4ea0-ad01-4fb3ba08cadf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:34.389083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbe5a408-1e30-4ea0-ad01-4fb3ba08cadf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:34.389583 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbe5a408-1e30-4ea0-ad01-4fb3ba08cadf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:34.602248 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cbe5a408-1e30-4ea0-ad01-4fb3ba08cadf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:34.612055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cbe5a408-1e30-4ea0-ad01-4fb3ba08cadf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:34.613749 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cbe5a408-1e30-4ea0-ad01-4fb3ba08cadf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:34.614967 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cbe5a408-1e30-4ea0-ad01-4fb3ba08cadf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.246310 Apr 14 16:13:34.615582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 213/423] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:34 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:13:34.620308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b41934a3-634c-494c-9617-62c0a3ab39ff tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:34.620972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b41934a3-634c-494c-9617-62c0a3ab39ff tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:34.628548 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b41934a3-634c-494c-9617-62c0a3ab39ff tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:34.629075 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b41934a3-634c-494c-9617-62c0a3ab39ff tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:34.629904 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b41934a3-634c-494c-9617-62c0a3ab39ff tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:34.630391 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b41934a3-634c-494c-9617-62c0a3ab39ff tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:34.838486 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b41934a3-634c-494c-9617-62c0a3ab39ff tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:34.848969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b41934a3-634c-494c-9617-62c0a3ab39ff tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1318 microversion: 2.1 time: 0.232238 Apr 14 16:13:34.849834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 214/424] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:34 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:35.100300 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a0be84cc-6c43-4dd7-a272-6ce014e4e3d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "POST /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/action" status: 202 len: 0 microversion: 2.1 time: 1.326756 Apr 14 16:13:35.101311 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 211/425] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:33 2021] POST /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/action => generated 0 bytes in 1329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:35.113837 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-275a5c84-8a49-4adc-9bcc-f3ce4bdec388 req-cf358438-20ac-45dc-ac58-8278350edb7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93346a14-b6f5-4d77-a1a7-f4d649c7ccd5", "tag": "3a58c362-2e99-4559-9977-3b635ab88161"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:35.115642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:13:35.115642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:13:35.120412 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2262aea2-dd06-4676-8e7f-0a77b7bffccd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:35.121843 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2262aea2-dd06-4676-8e7f-0a77b7bffccd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:35.142459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2262aea2-dd06-4676-8e7f-0a77b7bffccd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:35.142965 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2262aea2-dd06-4676-8e7f-0a77b7bffccd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:35.143824 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2262aea2-dd06-4676-8e7f-0a77b7bffccd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:35.154470 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-275a5c84-8a49-4adc-9bcc-f3ce4bdec388 req-cf358438-20ac-45dc-ac58-8278350edb7f service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:35.155574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2262aea2-dd06-4676-8e7f-0a77b7bffccd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:35.159449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-275a5c84-8a49-4adc-9bcc-f3ce4bdec388 req-cf358438-20ac-45dc-ac58-8278350edb7f service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:35.210390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-275a5c84-8a49-4adc-9bcc-f3ce4bdec388 req-cf358438-20ac-45dc-ac58-8278350edb7f service nova] Creating event network-changed:3a58c362-2e99-4559-9977-3b635ab88161 for instance 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 on hv-cinder-78626 Apr 14 16:13:35.216197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-275a5c84-8a49-4adc-9bcc-f3ce4bdec388 req-cf358438-20ac-45dc-ac58-8278350edb7f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106554 Apr 14 16:13:35.219581 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 212/426] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:13:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:13:35.225798 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bec99067-98fc-4fef-bca6-27aad8656744 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:35.226582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bec99067-98fc-4fef-bca6-27aad8656744 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:35.237449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bec99067-98fc-4fef-bca6-27aad8656744 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:35.238147 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bec99067-98fc-4fef-bca6-27aad8656744 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:35.239356 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bec99067-98fc-4fef-bca6-27aad8656744 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:35.239863 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bec99067-98fc-4fef-bca6-27aad8656744 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:35.486628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bec99067-98fc-4fef-bca6-27aad8656744 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:35.503002 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bec99067-98fc-4fef-bca6-27aad8656744 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.281650 Apr 14 16:13:35.504019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 213/427] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:35 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:35.508993 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8af7a38d-315b-4c2c-80b9-f526017729d6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:35.510066 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8af7a38d-315b-4c2c-80b9-f526017729d6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:35.519014 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8af7a38d-315b-4c2c-80b9-f526017729d6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:35.519512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8af7a38d-315b-4c2c-80b9-f526017729d6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:35.520345 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8af7a38d-315b-4c2c-80b9-f526017729d6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:35.521210 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8af7a38d-315b-4c2c-80b9-f526017729d6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:35.595884 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2262aea2-dd06-4676-8e7f-0a77b7bffccd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:35.607409 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2262aea2-dd06-4676-8e7f-0a77b7bffccd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1759 microversion: 2.1 time: 0.500853 Apr 14 16:13:35.608326 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 215/428] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:35 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1759 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:35.636801 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a0d9bc49-e7bd-4887-bdfa-746d39b236ee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:35.637772 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a0d9bc49-e7bd-4887-bdfa-746d39b236ee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:35.646124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0d9bc49-e7bd-4887-bdfa-746d39b236ee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:35.646750 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0d9bc49-e7bd-4887-bdfa-746d39b236ee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:35.647833 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0d9bc49-e7bd-4887-bdfa-746d39b236ee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:35.648460 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0d9bc49-e7bd-4887-bdfa-746d39b236ee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:35.852586 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8af7a38d-315b-4c2c-80b9-f526017729d6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 38107 microversion: 2.1 time: 0.346947 Apr 14 16:13:35.854223 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 214/429] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:35 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 38107 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:35.870005 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e817df67-90ae-4e36-aa80-24a5bb163a07 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:35.870616 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e817df67-90ae-4e36-aa80-24a5bb163a07 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:35.881419 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e817df67-90ae-4e36-aa80-24a5bb163a07 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:35.882247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e817df67-90ae-4e36-aa80-24a5bb163a07 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:35.883162 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e817df67-90ae-4e36-aa80-24a5bb163a07 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:35.883875 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e817df67-90ae-4e36-aa80-24a5bb163a07 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:36.058436 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a0d9bc49-e7bd-4887-bdfa-746d39b236ee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:36.068562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a0d9bc49-e7bd-4887-bdfa-746d39b236ee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:36.070536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a0d9bc49-e7bd-4887-bdfa-746d39b236ee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:36.071976 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a0d9bc49-e7bd-4887-bdfa-746d39b236ee tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.440138 Apr 14 16:13:36.072837 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 216/430] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:35 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:36.104850 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e817df67-90ae-4e36-aa80-24a5bb163a07 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:36.114983 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e817df67-90ae-4e36-aa80-24a5bb163a07 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1318 microversion: 2.1 time: 0.250498 Apr 14 16:13:36.132300 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 215/431] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:35 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:36.521925 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-eb2b33d0-0b0c-437d-87b6-9dabc215604e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:36.522706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-eb2b33d0-0b0c-437d-87b6-9dabc215604e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:36.531249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb2b33d0-0b0c-437d-87b6-9dabc215604e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:36.531873 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb2b33d0-0b0c-437d-87b6-9dabc215604e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:36.532803 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb2b33d0-0b0c-437d-87b6-9dabc215604e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:36.533645 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb2b33d0-0b0c-437d-87b6-9dabc215604e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:36.867250 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-40c515e1-489f-4667-b35b-2637e9c26a33 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:36.868295 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-40c515e1-489f-4667-b35b-2637e9c26a33 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:36.876257 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40c515e1-489f-4667-b35b-2637e9c26a33 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:36.876502 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-eb2b33d0-0b0c-437d-87b6-9dabc215604e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:36.876753 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40c515e1-489f-4667-b35b-2637e9c26a33 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:36.877590 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40c515e1-489f-4667-b35b-2637e9c26a33 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:36.878075 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40c515e1-489f-4667-b35b-2637e9c26a33 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:36.885577 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-eb2b33d0-0b0c-437d-87b6-9dabc215604e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1500 microversion: 2.1 time: 0.367673 Apr 14 16:13:36.886213 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 217/432] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:36 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1500 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:36.904493 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f86e3e2b-db72-4204-8f2a-7c66a8c3613e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91c99c4b-6748-4c96-af2e-30f7e7d36226"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:36.905782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f86e3e2b-db72-4204-8f2a-7c66a8c3613e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:36.913977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f86e3e2b-db72-4204-8f2a-7c66a8c3613e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:36.914470 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f86e3e2b-db72-4204-8f2a-7c66a8c3613e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:36.915320 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f86e3e2b-db72-4204-8f2a-7c66a8c3613e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:36.915820 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f86e3e2b-db72-4204-8f2a-7c66a8c3613e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:36.979891 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-f86e3e2b-db72-4204-8f2a-7c66a8c3613e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] HTTP exception thrown: Cannot 'attach_volume' instance 0a704e48-ff08-4961-9c93-7a0fdf04543d while it is in vm_state rescued Apr 14 16:13:36.980981 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f86e3e2b-db72-4204-8f2a-7c66a8c3613e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Returning 409 to user: Cannot 'attach_volume' instance 0a704e48-ff08-4961-9c93-7a0fdf04543d while it is in vm_state rescued {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:13:36.982115 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f86e3e2b-db72-4204-8f2a-7c66a8c3613e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "POST /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.082502 Apr 14 16:13:36.983545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 218/433] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Apr 14 16:13:36 2021] POST /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/os-volume_attachments => generated 152 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 14 16:13:36.991591 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a415faae-7229-4c8d-a863-ee7c55796928 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:36.992179 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a415faae-7229-4c8d-a863-ee7c55796928 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:37.001144 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a415faae-7229-4c8d-a863-ee7c55796928 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:37.001651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a415faae-7229-4c8d-a863-ee7c55796928 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:37.002487 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a415faae-7229-4c8d-a863-ee7c55796928 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:37.002978 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a415faae-7229-4c8d-a863-ee7c55796928 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:37.090031 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-40c515e1-489f-4667-b35b-2637e9c26a33 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 38348 microversion: 2.1 time: 0.226890 Apr 14 16:13:37.090895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 216/434] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:36 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 38348 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:13:37.096261 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8b704fdb-4f4f-493d-8cc4-3d1eced16988 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:37.097081 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8b704fdb-4f4f-493d-8cc4-3d1eced16988 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:37.105903 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8b704fdb-4f4f-493d-8cc4-3d1eced16988 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:37.106560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8b704fdb-4f4f-493d-8cc4-3d1eced16988 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:37.107409 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8b704fdb-4f4f-493d-8cc4-3d1eced16988 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:37.107900 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8b704fdb-4f4f-493d-8cc4-3d1eced16988 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:37.163543 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a415faae-7229-4c8d-a863-ee7c55796928 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "POST /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/action" status: 202 len: 0 microversion: 2.1 time: 0.175595 Apr 14 16:13:37.164372 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 219/435] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:36 2021] POST /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:13:37.170543 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bd578225-0b93-4cc2-bd36-2e7c6c8d227e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:37.171302 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bd578225-0b93-4cc2-bd36-2e7c6c8d227e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:37.179278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd578225-0b93-4cc2-bd36-2e7c6c8d227e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:37.179786 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd578225-0b93-4cc2-bd36-2e7c6c8d227e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:37.180625 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd578225-0b93-4cc2-bd36-2e7c6c8d227e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:37.181181 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd578225-0b93-4cc2-bd36-2e7c6c8d227e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:37.326685 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8b704fdb-4f4f-493d-8cc4-3d1eced16988 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:37.343702 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8b704fdb-4f4f-493d-8cc4-3d1eced16988 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:37.346195 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8b704fdb-4f4f-493d-8cc4-3d1eced16988 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:37.347485 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8b704fdb-4f4f-493d-8cc4-3d1eced16988 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.255394 Apr 14 16:13:37.361189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 217/436] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:37 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:37.361189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8baf1266-4ed6-4759-bd21-b4fd6e40dfcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:37.361189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8baf1266-4ed6-4759-bd21-b4fd6e40dfcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:37.366440 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8baf1266-4ed6-4759-bd21-b4fd6e40dfcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:37.367317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8baf1266-4ed6-4759-bd21-b4fd6e40dfcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:37.367788 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8baf1266-4ed6-4759-bd21-b4fd6e40dfcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:37.368295 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8baf1266-4ed6-4759-bd21-b4fd6e40dfcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:37.469055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bd578225-0b93-4cc2-bd36-2e7c6c8d227e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:37.478015 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bd578225-0b93-4cc2-bd36-2e7c6c8d227e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1318 microversion: 2.1 time: 0.312291 Apr 14 16:13:37.479039 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 220/437] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:37 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:37.590769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8baf1266-4ed6-4759-bd21-b4fd6e40dfcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:37.600137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8baf1266-4ed6-4759-bd21-b4fd6e40dfcf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1508 microversion: 2.1 time: 0.250676 Apr 14 16:13:37.600994 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 218/438] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:37 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:38.102847 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1d9beb1c-b96c-4b12-8969-cc00ed58ad3a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:38.104180 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1d9beb1c-b96c-4b12-8969-cc00ed58ad3a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:38.113148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d9beb1c-b96c-4b12-8969-cc00ed58ad3a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:38.113610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d9beb1c-b96c-4b12-8969-cc00ed58ad3a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:38.114388 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d9beb1c-b96c-4b12-8969-cc00ed58ad3a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:38.114894 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d9beb1c-b96c-4b12-8969-cc00ed58ad3a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:38.323322 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1d9beb1c-b96c-4b12-8969-cc00ed58ad3a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 38499 microversion: 2.1 time: 0.224407 Apr 14 16:13:38.324938 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 221/439] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:38 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 38499 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:13:38.368255 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-21d23c10-8acd-486a-97fc-94e4296d8cb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:38.368921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-21d23c10-8acd-486a-97fc-94e4296d8cb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:38.377697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-21d23c10-8acd-486a-97fc-94e4296d8cb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:38.378207 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-21d23c10-8acd-486a-97fc-94e4296d8cb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:38.379057 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-21d23c10-8acd-486a-97fc-94e4296d8cb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:38.379552 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-21d23c10-8acd-486a-97fc-94e4296d8cb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:38.497073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b762ee7c-bca4-423d-9d8c-0b997df0d6e7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:38.497857 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b762ee7c-bca4-423d-9d8c-0b997df0d6e7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:38.506471 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b762ee7c-bca4-423d-9d8c-0b997df0d6e7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:38.506992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b762ee7c-bca4-423d-9d8c-0b997df0d6e7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:38.507841 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b762ee7c-bca4-423d-9d8c-0b997df0d6e7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:38.508340 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b762ee7c-bca4-423d-9d8c-0b997df0d6e7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:38.586133 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-21d23c10-8acd-486a-97fc-94e4296d8cb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:38.597236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-21d23c10-8acd-486a-97fc-94e4296d8cb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:38.598929 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-21d23c10-8acd-486a-97fc-94e4296d8cb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:38.600175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-21d23c10-8acd-486a-97fc-94e4296d8cb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.236119 Apr 14 16:13:38.600841 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 219/440] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:38 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:38.618798 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3f5d0998-b741-4a9a-9172-874b170c0a28 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:38.619441 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3f5d0998-b741-4a9a-9172-874b170c0a28 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:38.627876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3f5d0998-b741-4a9a-9172-874b170c0a28 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:38.628380 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3f5d0998-b741-4a9a-9172-874b170c0a28 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:38.629277 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3f5d0998-b741-4a9a-9172-874b170c0a28 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:38.629781 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3f5d0998-b741-4a9a-9172-874b170c0a28 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:38.711443 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b762ee7c-bca4-423d-9d8c-0b997df0d6e7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:38.720679 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b762ee7c-bca4-423d-9d8c-0b997df0d6e7 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1507 microversion: 2.1 time: 0.228569 Apr 14 16:13:38.721549 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 222/441] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:38 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1507 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:38.837936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3f5d0998-b741-4a9a-9172-874b170c0a28 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:38.849369 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3f5d0998-b741-4a9a-9172-874b170c0a28 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1508 microversion: 2.1 time: 0.234276 Apr 14 16:13:38.850137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 220/442] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:38 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:13:39.337061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-48778975-2355-4c65-9f22-bbafa8dde46e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:39.338166 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-48778975-2355-4c65-9f22-bbafa8dde46e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:39.347240 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-48778975-2355-4c65-9f22-bbafa8dde46e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:39.347747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-48778975-2355-4c65-9f22-bbafa8dde46e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:39.348584 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-48778975-2355-4c65-9f22-bbafa8dde46e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:39.349156 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-48778975-2355-4c65-9f22-bbafa8dde46e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:39.493554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-48778975-2355-4c65-9f22-bbafa8dde46e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 200 len: 38660 microversion: 2.1 time: 0.160368 Apr 14 16:13:39.494270 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 223/443] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:39 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 38660 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:13:39.505344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a7215ab7-2ece-4f95-9205-96efeb224de7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:39.506110 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a7215ab7-2ece-4f95-9205-96efeb224de7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:39.514577 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a7215ab7-2ece-4f95-9205-96efeb224de7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:39.515083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a7215ab7-2ece-4f95-9205-96efeb224de7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:39.515907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a7215ab7-2ece-4f95-9205-96efeb224de7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:39.516390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a7215ab7-2ece-4f95-9205-96efeb224de7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:39.580362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a7215ab7-2ece-4f95-9205-96efeb224de7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/ips" status: 200 len: 145 microversion: 2.1 time: 0.079018 Apr 14 16:13:39.581007 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 221/444] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Apr 14 16:13:39 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/ips => generated 145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:13:39.621387 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-704986b2-4f7a-45b3-9a8b-bc8f4e5d6a32 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:39.622678 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-704986b2-4f7a-45b3-9a8b-bc8f4e5d6a32 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:39.632549 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-704986b2-4f7a-45b3-9a8b-bc8f4e5d6a32 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:39.633137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-704986b2-4f7a-45b3-9a8b-bc8f4e5d6a32 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:39.634019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-704986b2-4f7a-45b3-9a8b-bc8f4e5d6a32 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:39.634522 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-704986b2-4f7a-45b3-9a8b-bc8f4e5d6a32 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:39.838159 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-704986b2-4f7a-45b3-9a8b-bc8f4e5d6a32 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:39.849603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-704986b2-4f7a-45b3-9a8b-bc8f4e5d6a32 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:39.851381 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-704986b2-4f7a-45b3-9a8b-bc8f4e5d6a32 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:39.852714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-704986b2-4f7a-45b3-9a8b-bc8f4e5d6a32 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.237108 Apr 14 16:13:39.853465 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 224/445] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:39 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:39.870971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e304ddd4-6d67-4ed4-9f23-f1049f3cd73d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:39.871911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e304ddd4-6d67-4ed4-9f23-f1049f3cd73d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:39.880055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e304ddd4-6d67-4ed4-9f23-f1049f3cd73d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:39.880853 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e304ddd4-6d67-4ed4-9f23-f1049f3cd73d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:39.881911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e304ddd4-6d67-4ed4-9f23-f1049f3cd73d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:39.882635 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e304ddd4-6d67-4ed4-9f23-f1049f3cd73d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:40.087437 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e304ddd4-6d67-4ed4-9f23-f1049f3cd73d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:40.097055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e304ddd4-6d67-4ed4-9f23-f1049f3cd73d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1508 microversion: 2.1 time: 0.230201 Apr 14 16:13:40.097911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 222/446] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:39 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:40.269815 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e59a2b39-13c3-4826-b819-237996b4aee9 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f50fb235-baa9-4106-ad95-4e61c68d8354"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:40.271019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e59a2b39-13c3-4826-b819-237996b4aee9 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:40.280160 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e59a2b39-13c3-4826-b819-237996b4aee9 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:40.280778 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e59a2b39-13c3-4826-b819-237996b4aee9 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:40.281854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e59a2b39-13c3-4826-b819-237996b4aee9 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:40.282355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e59a2b39-13c3-4826-b819-237996b4aee9 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:40.716482 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e59a2b39-13c3-4826-b819-237996b4aee9 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "POST /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.450489 Apr 14 16:13:40.717523 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 225/447] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Apr 14 16:13:40 2021] POST /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857/os-volume_attachments => generated 194 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:13:40.873560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-befa64b6-cd7a-4856-ad02-ad8d11cc3a3a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:40.874220 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-befa64b6-cd7a-4856-ad02-ad8d11cc3a3a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:40.882328 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-befa64b6-cd7a-4856-ad02-ad8d11cc3a3a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:40.882835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-befa64b6-cd7a-4856-ad02-ad8d11cc3a3a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:40.883645 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-befa64b6-cd7a-4856-ad02-ad8d11cc3a3a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:40.884362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-befa64b6-cd7a-4856-ad02-ad8d11cc3a3a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:41.096880 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-befa64b6-cd7a-4856-ad02-ad8d11cc3a3a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:41.107013 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-befa64b6-cd7a-4856-ad02-ad8d11cc3a3a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:41.108697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-befa64b6-cd7a-4856-ad02-ad8d11cc3a3a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:41.110016 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-befa64b6-cd7a-4856-ad02-ad8d11cc3a3a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.240593 Apr 14 16:13:41.110634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 223/448] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:40 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:13:41.116694 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5eacb4f6-b559-40e1-82a2-74226a058eb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:41.117747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5eacb4f6-b559-40e1-82a2-74226a058eb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:41.127999 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5eacb4f6-b559-40e1-82a2-74226a058eb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:41.128720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5eacb4f6-b559-40e1-82a2-74226a058eb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:41.129917 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5eacb4f6-b559-40e1-82a2-74226a058eb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:41.133245 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5eacb4f6-b559-40e1-82a2-74226a058eb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:41.330934 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5eacb4f6-b559-40e1-82a2-74226a058eb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:41.340960 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5eacb4f6-b559-40e1-82a2-74226a058eb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1508 microversion: 2.1 time: 0.227974 Apr 14 16:13:41.341646 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 226/449] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:41 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1508 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:42.132972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-94afff71-3f04-49d1-b567-26b53b99bffa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:42.134500 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-94afff71-3f04-49d1-b567-26b53b99bffa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:42.153966 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94afff71-3f04-49d1-b567-26b53b99bffa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:42.158052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94afff71-3f04-49d1-b567-26b53b99bffa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:42.159562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94afff71-3f04-49d1-b567-26b53b99bffa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:42.161422 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94afff71-3f04-49d1-b567-26b53b99bffa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:42.359337 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3e967948-65f4-44ed-97cf-4f4189a507f0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:42.360133 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3e967948-65f4-44ed-97cf-4f4189a507f0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:42.368585 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e967948-65f4-44ed-97cf-4f4189a507f0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:42.369249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e967948-65f4-44ed-97cf-4f4189a507f0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:42.370179 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e967948-65f4-44ed-97cf-4f4189a507f0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:42.372050 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e967948-65f4-44ed-97cf-4f4189a507f0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:42.375134 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-94afff71-3f04-49d1-b567-26b53b99bffa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:42.384544 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-94afff71-3f04-49d1-b567-26b53b99bffa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:42.386259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-94afff71-3f04-49d1-b567-26b53b99bffa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:42.388618 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-94afff71-3f04-49d1-b567-26b53b99bffa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.261380 Apr 14 16:13:42.389288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 224/450] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:42 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:42.580468 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3e967948-65f4-44ed-97cf-4f4189a507f0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:42.590566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3e967948-65f4-44ed-97cf-4f4189a507f0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1508 microversion: 2.1 time: 0.234911 Apr 14 16:13:42.591386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 227/451] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:42 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:43.379696 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b57a5a93-7686-49e1-a235-90c1897bedf7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecf2c572-09d3-4ca9-bacb-d45b2cdea9e7"}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:43.381103 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b57a5a93-7686-49e1-a235-90c1897bedf7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:43.390204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b57a5a93-7686-49e1-a235-90c1897bedf7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:43.390711 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b57a5a93-7686-49e1-a235-90c1897bedf7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:43.391860 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b57a5a93-7686-49e1-a235-90c1897bedf7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:43.392551 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b57a5a93-7686-49e1-a235-90c1897bedf7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:43.409104 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2fd199ae-284a-4d78-b1df-8c7ad9b707d8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:43.409907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2fd199ae-284a-4d78-b1df-8c7ad9b707d8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:43.417938 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2fd199ae-284a-4d78-b1df-8c7ad9b707d8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:43.418670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2fd199ae-284a-4d78-b1df-8c7ad9b707d8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:43.419609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2fd199ae-284a-4d78-b1df-8c7ad9b707d8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:43.420205 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2fd199ae-284a-4d78-b1df-8c7ad9b707d8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:43.625249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2fd199ae-284a-4d78-b1df-8c7ad9b707d8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:43.634802 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2fd199ae-284a-4d78-b1df-8c7ad9b707d8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:43.636493 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2fd199ae-284a-4d78-b1df-8c7ad9b707d8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:43.637789 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2fd199ae-284a-4d78-b1df-8c7ad9b707d8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.233064 Apr 14 16:13:43.638421 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 228/452] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:43 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:43.643304 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c1f0144a-b031-423d-95a7-9d1e9b3313c9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:43.643976 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c1f0144a-b031-423d-95a7-9d1e9b3313c9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:43.653501 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1f0144a-b031-423d-95a7-9d1e9b3313c9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:43.654015 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1f0144a-b031-423d-95a7-9d1e9b3313c9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:43.654863 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1f0144a-b031-423d-95a7-9d1e9b3313c9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:43.655357 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1f0144a-b031-423d-95a7-9d1e9b3313c9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:43.826553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b57a5a93-7686-49e1-a235-90c1897bedf7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.450611 Apr 14 16:13:43.826998 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 225/453] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Apr 14 16:13:43 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/os-volume_attachments => generated 194 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:13:43.870139 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c1f0144a-b031-423d-95a7-9d1e9b3313c9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:43.880615 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c1f0144a-b031-423d-95a7-9d1e9b3313c9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1514 microversion: 2.1 time: 0.240973 Apr 14 16:13:43.881221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 229/454] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:43 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:44.657973 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bdc4d343-a8f2-4357-abf7-3ec7b22a9586 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:44.659001 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bdc4d343-a8f2-4357-abf7-3ec7b22a9586 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:44.668528 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdc4d343-a8f2-4357-abf7-3ec7b22a9586 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:44.669068 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdc4d343-a8f2-4357-abf7-3ec7b22a9586 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:44.669936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdc4d343-a8f2-4357-abf7-3ec7b22a9586 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:44.670396 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdc4d343-a8f2-4357-abf7-3ec7b22a9586 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:44.873843 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bdc4d343-a8f2-4357-abf7-3ec7b22a9586 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:44.883301 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bdc4d343-a8f2-4357-abf7-3ec7b22a9586 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:44.884965 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bdc4d343-a8f2-4357-abf7-3ec7b22a9586 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:44.886730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bdc4d343-a8f2-4357-abf7-3ec7b22a9586 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.233029 Apr 14 16:13:44.887434 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 226/455] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:44 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:45.453713 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4744f82c-bb35-4140-8803-677951f80c0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:45.454780 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4744f82c-bb35-4140-8803-677951f80c0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:45.463371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4744f82c-bb35-4140-8803-677951f80c0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:45.463877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4744f82c-bb35-4140-8803-677951f80c0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:45.464764 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4744f82c-bb35-4140-8803-677951f80c0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:45.465286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4744f82c-bb35-4140-8803-677951f80c0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:45.673458 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4744f82c-bb35-4140-8803-677951f80c0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:45.682275 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4744f82c-bb35-4140-8803-677951f80c0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1514 microversion: 2.1 time: 0.234352 Apr 14 16:13:45.682912 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 230/456] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:45 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:45.701079 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-076da318-7b94-440b-961c-5eb5df84581c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18a07076-8fd4-4767-85c6-15611ad95ab6"}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:45.702358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-076da318-7b94-440b-961c-5eb5df84581c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:45.710221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-076da318-7b94-440b-961c-5eb5df84581c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:45.710723 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-076da318-7b94-440b-961c-5eb5df84581c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:45.711554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-076da318-7b94-440b-961c-5eb5df84581c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:45.712044 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-076da318-7b94-440b-961c-5eb5df84581c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:45.907043 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-949ef315-451e-411b-998d-2baa4a6851db tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:45.907793 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-949ef315-451e-411b-998d-2baa4a6851db tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:45.915992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-949ef315-451e-411b-998d-2baa4a6851db tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:45.916494 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-949ef315-451e-411b-998d-2baa4a6851db tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:45.917359 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-949ef315-451e-411b-998d-2baa4a6851db tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:45.917908 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-949ef315-451e-411b-998d-2baa4a6851db tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:46.147757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-076da318-7b94-440b-961c-5eb5df84581c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "POST /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.451289 Apr 14 16:13:46.154871 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-949ef315-451e-411b-998d-2baa4a6851db tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:46.155721 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 227/457] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Apr 14 16:13:45 2021] POST /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/os-volume_attachments => generated 194 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:13:46.168784 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-949ef315-451e-411b-998d-2baa4a6851db tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:46.170510 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-949ef315-451e-411b-998d-2baa4a6851db tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:46.171756 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-949ef315-451e-411b-998d-2baa4a6851db tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.269443 Apr 14 16:13:46.172566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 231/458] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:45 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:13:47.193262 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b04175f7-d3a0-493b-8708-53a017d4cf63 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:47.194032 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b04175f7-d3a0-493b-8708-53a017d4cf63 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:47.206873 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b04175f7-d3a0-493b-8708-53a017d4cf63 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:47.207383 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b04175f7-d3a0-493b-8708-53a017d4cf63 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:47.208228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b04175f7-d3a0-493b-8708-53a017d4cf63 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:47.208717 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b04175f7-d3a0-493b-8708-53a017d4cf63 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:47.408869 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b04175f7-d3a0-493b-8708-53a017d4cf63 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:47.422640 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b04175f7-d3a0-493b-8708-53a017d4cf63 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:47.424337 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b04175f7-d3a0-493b-8708-53a017d4cf63 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:47.425631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b04175f7-d3a0-493b-8708-53a017d4cf63 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.237509 Apr 14 16:13:47.426247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 228/459] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:47 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:48.446275 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-66b288ee-c989-4db8-aca4-bfa2c16e5d35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:48.446992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-66b288ee-c989-4db8-aca4-bfa2c16e5d35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:48.455391 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-66b288ee-c989-4db8-aca4-bfa2c16e5d35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:48.455903 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-66b288ee-c989-4db8-aca4-bfa2c16e5d35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:48.456739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-66b288ee-c989-4db8-aca4-bfa2c16e5d35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:48.457261 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-66b288ee-c989-4db8-aca4-bfa2c16e5d35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:48.659974 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-66b288ee-c989-4db8-aca4-bfa2c16e5d35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:48.670462 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-66b288ee-c989-4db8-aca4-bfa2c16e5d35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:48.672158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-66b288ee-c989-4db8-aca4-bfa2c16e5d35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:48.673525 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-66b288ee-c989-4db8-aca4-bfa2c16e5d35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.231722 Apr 14 16:13:48.674166 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 232/460] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:48 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:49.692660 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e2e489a6-bc9a-4af6-99a5-22da43f72688 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:49.693238 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e2e489a6-bc9a-4af6-99a5-22da43f72688 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:49.702255 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e2e489a6-bc9a-4af6-99a5-22da43f72688 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:49.702764 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e2e489a6-bc9a-4af6-99a5-22da43f72688 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:49.703602 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e2e489a6-bc9a-4af6-99a5-22da43f72688 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:49.704094 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e2e489a6-bc9a-4af6-99a5-22da43f72688 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:49.913020 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e2e489a6-bc9a-4af6-99a5-22da43f72688 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:49.922913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e2e489a6-bc9a-4af6-99a5-22da43f72688 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:49.924608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e2e489a6-bc9a-4af6-99a5-22da43f72688 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:49.925945 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e2e489a6-bc9a-4af6-99a5-22da43f72688 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.237498 Apr 14 16:13:49.926562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 229/461] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:49 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:50.137055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c4b7f32e-1b85-4528-b902-db248f1ec2d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:50.137627 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c4b7f32e-1b85-4528-b902-db248f1ec2d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:50.146768 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4b7f32e-1b85-4528-b902-db248f1ec2d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:50.147286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4b7f32e-1b85-4528-b902-db248f1ec2d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:50.148160 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4b7f32e-1b85-4528-b902-db248f1ec2d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:50.148663 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4b7f32e-1b85-4528-b902-db248f1ec2d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:50.323805 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-c4b7f32e-1b85-4528-b902-db248f1ec2d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lazy-loading 'services' on Instance uuid 304001e9-ca53-4ab3-be25-483e56e3b857 {{(pid=99335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:13:50.469869 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c4b7f32e-1b85-4528-b902-db248f1ec2d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "DELETE /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857/os-volume_attachments/f50fb235-baa9-4106-ad95-4e61c68d8354" status: 202 len: 0 microversion: 2.1 time: 0.336771 Apr 14 16:13:50.470602 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 233/462] 10.222.0.60 () {58 vars in 1406 bytes} [Wed Apr 14 16:13:50 2021] DELETE /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857/os-volume_attachments/f50fb235-baa9-4106-ad95-4e61c68d8354 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:13:50.945644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bbb6b7be-2862-4fc0-af69-5eb5e59f1ff1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:50.946315 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bbb6b7be-2862-4fc0-af69-5eb5e59f1ff1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:50.954662 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bbb6b7be-2862-4fc0-af69-5eb5e59f1ff1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:50.955168 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bbb6b7be-2862-4fc0-af69-5eb5e59f1ff1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:50.956007 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bbb6b7be-2862-4fc0-af69-5eb5e59f1ff1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:50.956496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bbb6b7be-2862-4fc0-af69-5eb5e59f1ff1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:51.168800 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bbb6b7be-2862-4fc0-af69-5eb5e59f1ff1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:51.178256 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bbb6b7be-2862-4fc0-af69-5eb5e59f1ff1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:51.179935 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bbb6b7be-2862-4fc0-af69-5eb5e59f1ff1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:51.181206 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bbb6b7be-2862-4fc0-af69-5eb5e59f1ff1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.240165 Apr 14 16:13:51.181822 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 230/463] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:50 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:52.202809 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-23925187-8e56-4965-a002-149e2e562295 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:52.203691 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-23925187-8e56-4965-a002-149e2e562295 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:52.211907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23925187-8e56-4965-a002-149e2e562295 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:52.212412 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23925187-8e56-4965-a002-149e2e562295 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:52.213300 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23925187-8e56-4965-a002-149e2e562295 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:52.213789 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23925187-8e56-4965-a002-149e2e562295 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:52.420580 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-23925187-8e56-4965-a002-149e2e562295 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:52.430671 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-23925187-8e56-4965-a002-149e2e562295 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:52.432363 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-23925187-8e56-4965-a002-149e2e562295 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:52.433769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-23925187-8e56-4965-a002-149e2e562295 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.236584 Apr 14 16:13:52.434395 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 234/464] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:52 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:53.453640 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-42ca3e91-3ac1-4bc1-a8a4-ab534656dc69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:53.454291 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-42ca3e91-3ac1-4bc1-a8a4-ab534656dc69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:53.462695 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-42ca3e91-3ac1-4bc1-a8a4-ab534656dc69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:53.463186 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-42ca3e91-3ac1-4bc1-a8a4-ab534656dc69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:53.464014 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-42ca3e91-3ac1-4bc1-a8a4-ab534656dc69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:53.465772 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-42ca3e91-3ac1-4bc1-a8a4-ab534656dc69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:53.673600 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-42ca3e91-3ac1-4bc1-a8a4-ab534656dc69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:53.682849 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-42ca3e91-3ac1-4bc1-a8a4-ab534656dc69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:53.684717 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-42ca3e91-3ac1-4bc1-a8a4-ab534656dc69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:53.685963 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-42ca3e91-3ac1-4bc1-a8a4-ab534656dc69 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.236552 Apr 14 16:13:53.686579 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 231/465] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:53 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:54.706761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b1b9ee2a-819c-4a21-ac2b-93663f01269b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:54.707433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b1b9ee2a-819c-4a21-ac2b-93663f01269b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:54.715871 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b1b9ee2a-819c-4a21-ac2b-93663f01269b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:54.716382 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b1b9ee2a-819c-4a21-ac2b-93663f01269b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:54.717250 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b1b9ee2a-819c-4a21-ac2b-93663f01269b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:54.717746 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b1b9ee2a-819c-4a21-ac2b-93663f01269b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:54.911728 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b1b9ee2a-819c-4a21-ac2b-93663f01269b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:54.922242 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b1b9ee2a-819c-4a21-ac2b-93663f01269b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:54.923939 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b1b9ee2a-819c-4a21-ac2b-93663f01269b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:54.925207 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b1b9ee2a-819c-4a21-ac2b-93663f01269b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.223322 Apr 14 16:13:54.925847 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 235/466] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:54 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:55.946294 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c28f95b8-fa9b-4340-ad96-887756d082b1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:55.946952 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c28f95b8-fa9b-4340-ad96-887756d082b1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:55.955520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c28f95b8-fa9b-4340-ad96-887756d082b1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:55.956025 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c28f95b8-fa9b-4340-ad96-887756d082b1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:55.956852 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c28f95b8-fa9b-4340-ad96-887756d082b1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:55.957369 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c28f95b8-fa9b-4340-ad96-887756d082b1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:56.168204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c28f95b8-fa9b-4340-ad96-887756d082b1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:56.177913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c28f95b8-fa9b-4340-ad96-887756d082b1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:56.179603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c28f95b8-fa9b-4340-ad96-887756d082b1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:56.180839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c28f95b8-fa9b-4340-ad96-887756d082b1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.239277 Apr 14 16:13:56.181520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 232/467] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:55 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:57.201900 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-026f5e61-6505-403c-a1b2-e9c7059a58f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:57.202358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-026f5e61-6505-403c-a1b2-e9c7059a58f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:57.210229 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-026f5e61-6505-403c-a1b2-e9c7059a58f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:57.210750 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-026f5e61-6505-403c-a1b2-e9c7059a58f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:57.211596 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-026f5e61-6505-403c-a1b2-e9c7059a58f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:57.212097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-026f5e61-6505-403c-a1b2-e9c7059a58f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:57.227011 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2aa4e407-8c60-47ab-b8a4-36e80801f205 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:57.235350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2aa4e407-8c60-47ab-b8a4-36e80801f205 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:57.235913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2aa4e407-8c60-47ab-b8a4-36e80801f205 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:57.300435 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2aa4e407-8c60-47ab-b8a4-36e80801f205 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Going to try to stop instance {{(pid=99334) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 14 16:13:57.387321 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2aa4e407-8c60-47ab-b8a4-36e80801f205 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 202 len: 0 microversion: 2.1 time: 0.164032 Apr 14 16:13:57.387997 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 233/468] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:13:57 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:13:57.397458 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5d3e3f3a-064c-4488-9623-d56e00dfe9dc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:57.398245 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5d3e3f3a-064c-4488-9623-d56e00dfe9dc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:57.406924 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5d3e3f3a-064c-4488-9623-d56e00dfe9dc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:57.407430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5d3e3f3a-064c-4488-9623-d56e00dfe9dc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:57.408605 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5d3e3f3a-064c-4488-9623-d56e00dfe9dc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:57.409253 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5d3e3f3a-064c-4488-9623-d56e00dfe9dc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:57.444107 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-026f5e61-6505-403c-a1b2-e9c7059a58f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:57.454750 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-026f5e61-6505-403c-a1b2-e9c7059a58f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:57.456600 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-026f5e61-6505-403c-a1b2-e9c7059a58f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:57.458136 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-026f5e61-6505-403c-a1b2-e9c7059a58f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.260924 Apr 14 16:13:57.458860 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 236/469] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:57 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:57.631463 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5d3e3f3a-064c-4488-9623-d56e00dfe9dc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:57.641695 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5d3e3f3a-064c-4488-9623-d56e00dfe9dc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.248953 Apr 14 16:13:57.642369 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 234/470] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:57 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:13:58.478584 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-25071b16-2ef5-492c-80a4-0e0e99a73427 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:58.479421 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-25071b16-2ef5-492c-80a4-0e0e99a73427 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:58.487805 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25071b16-2ef5-492c-80a4-0e0e99a73427 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:58.488352 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25071b16-2ef5-492c-80a4-0e0e99a73427 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:58.489218 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25071b16-2ef5-492c-80a4-0e0e99a73427 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:58.489926 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25071b16-2ef5-492c-80a4-0e0e99a73427 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:58.660496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-950d170c-5a8c-42bf-9784-5ce039e264ea tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:58.661279 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-950d170c-5a8c-42bf-9784-5ce039e264ea tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:58.671520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-950d170c-5a8c-42bf-9784-5ce039e264ea tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:58.672127 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-950d170c-5a8c-42bf-9784-5ce039e264ea tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:58.673087 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-950d170c-5a8c-42bf-9784-5ce039e264ea tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:58.673659 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-950d170c-5a8c-42bf-9784-5ce039e264ea tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:58.689843 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-25071b16-2ef5-492c-80a4-0e0e99a73427 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:58.699576 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-25071b16-2ef5-492c-80a4-0e0e99a73427 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:58.701299 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-25071b16-2ef5-492c-80a4-0e0e99a73427 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:58.702537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-25071b16-2ef5-492c-80a4-0e0e99a73427 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.228043 Apr 14 16:13:58.703167 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 237/471] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:58 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:13:58.879724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-950d170c-5a8c-42bf-9784-5ce039e264ea tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:58.891173 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-950d170c-5a8c-42bf-9784-5ce039e264ea tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.234955 Apr 14 16:13:58.891819 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 235/472] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:58 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:59.722880 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-df6a080a-3714-4fea-b7f8-35af09897ca1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:59.723589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-df6a080a-3714-4fea-b7f8-35af09897ca1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:59.731892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df6a080a-3714-4fea-b7f8-35af09897ca1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:59.732404 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df6a080a-3714-4fea-b7f8-35af09897ca1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:59.733267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df6a080a-3714-4fea-b7f8-35af09897ca1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:59.733759 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df6a080a-3714-4fea-b7f8-35af09897ca1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:59.910740 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6740da08-d695-42cc-af9f-18d6776ee3de tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:13:59.911410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6740da08-d695-42cc-af9f-18d6776ee3de tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:13:59.924755 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6740da08-d695-42cc-af9f-18d6776ee3de tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:59.924755 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6740da08-d695-42cc-af9f-18d6776ee3de tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:59.924755 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6740da08-d695-42cc-af9f-18d6776ee3de tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:13:59.924755 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6740da08-d695-42cc-af9f-18d6776ee3de tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:13:59.938934 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-df6a080a-3714-4fea-b7f8-35af09897ca1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:59.954907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-df6a080a-3714-4fea-b7f8-35af09897ca1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:59.957234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-df6a080a-3714-4fea-b7f8-35af09897ca1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:13:59.959280 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-df6a080a-3714-4fea-b7f8-35af09897ca1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.240270 Apr 14 16:13:59.959981 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 238/473] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:13:59 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:00.130997 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6740da08-d695-42cc-af9f-18d6776ee3de tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:00.141946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6740da08-d695-42cc-af9f-18d6776ee3de tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.235492 Apr 14 16:14:00.142595 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 236/474] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:13:59 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:00.979636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c0c387d9-2989-4ffb-b146-69258122e11c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:00.980649 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c0c387d9-2989-4ffb-b146-69258122e11c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:00.988575 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0c387d9-2989-4ffb-b146-69258122e11c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:00.989139 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0c387d9-2989-4ffb-b146-69258122e11c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:00.989991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0c387d9-2989-4ffb-b146-69258122e11c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:00.990496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0c387d9-2989-4ffb-b146-69258122e11c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:01.160461 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-172b3a42-b01c-4552-8c39-c1b4104d6011 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:01.161191 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-172b3a42-b01c-4552-8c39-c1b4104d6011 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:01.169658 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-172b3a42-b01c-4552-8c39-c1b4104d6011 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:01.170163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-172b3a42-b01c-4552-8c39-c1b4104d6011 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:01.171005 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-172b3a42-b01c-4552-8c39-c1b4104d6011 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:01.171503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-172b3a42-b01c-4552-8c39-c1b4104d6011 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:01.194081 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c0c387d9-2989-4ffb-b146-69258122e11c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:01.206852 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c0c387d9-2989-4ffb-b146-69258122e11c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:01.208657 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c0c387d9-2989-4ffb-b146-69258122e11c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:01.210041 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c0c387d9-2989-4ffb-b146-69258122e11c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.234507 Apr 14 16:14:01.210966 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 239/475] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:00 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:01.370177 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-172b3a42-b01c-4552-8c39-c1b4104d6011 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:01.380864 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-172b3a42-b01c-4552-8c39-c1b4104d6011 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.224861 Apr 14 16:14:01.381536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 237/476] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:01 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:02.231248 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c9acb096-c427-46f3-95c2-39c132f52387 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:02.231923 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c9acb096-c427-46f3-95c2-39c132f52387 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:02.239812 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9acb096-c427-46f3-95c2-39c132f52387 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:02.240329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9acb096-c427-46f3-95c2-39c132f52387 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:02.241196 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9acb096-c427-46f3-95c2-39c132f52387 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:02.241703 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9acb096-c427-46f3-95c2-39c132f52387 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:02.399711 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b09f2da4-5197-4995-ac41-253bcbfb7454 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:02.400303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b09f2da4-5197-4995-ac41-253bcbfb7454 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:02.409401 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b09f2da4-5197-4995-ac41-253bcbfb7454 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:02.409917 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b09f2da4-5197-4995-ac41-253bcbfb7454 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:02.410761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b09f2da4-5197-4995-ac41-253bcbfb7454 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:02.411256 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b09f2da4-5197-4995-ac41-253bcbfb7454 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:02.443650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c9acb096-c427-46f3-95c2-39c132f52387 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:02.453249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c9acb096-c427-46f3-95c2-39c132f52387 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:02.454936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c9acb096-c427-46f3-95c2-39c132f52387 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:02.456170 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c9acb096-c427-46f3-95c2-39c132f52387 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1745 microversion: 2.20 time: 0.229764 Apr 14 16:14:02.456795 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 240/477] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:02 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1745 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:02.611447 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b09f2da4-5197-4995-ac41-253bcbfb7454 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:02.620884 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b09f2da4-5197-4995-ac41-253bcbfb7454 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.225448 Apr 14 16:14:02.621536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 238/478] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:02 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:03.476596 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-72093537-96a0-474e-a5e3-ad2266bf8a74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:03.477293 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-72093537-96a0-474e-a5e3-ad2266bf8a74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:03.485839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-72093537-96a0-474e-a5e3-ad2266bf8a74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:03.486414 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-72093537-96a0-474e-a5e3-ad2266bf8a74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:03.487269 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-72093537-96a0-474e-a5e3-ad2266bf8a74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:03.487895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-72093537-96a0-474e-a5e3-ad2266bf8a74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:03.640146 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7efe31dd-e29d-4e17-8dd3-54a6f9299baf tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:03.640808 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7efe31dd-e29d-4e17-8dd3-54a6f9299baf tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:03.648576 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7efe31dd-e29d-4e17-8dd3-54a6f9299baf tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:03.649081 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7efe31dd-e29d-4e17-8dd3-54a6f9299baf tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:03.649910 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7efe31dd-e29d-4e17-8dd3-54a6f9299baf tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:03.650394 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7efe31dd-e29d-4e17-8dd3-54a6f9299baf tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:03.696059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-72093537-96a0-474e-a5e3-ad2266bf8a74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:03.706842 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-72093537-96a0-474e-a5e3-ad2266bf8a74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:03.709180 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-72093537-96a0-474e-a5e3-ad2266bf8a74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:03.710756 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-72093537-96a0-474e-a5e3-ad2266bf8a74 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1745 microversion: 2.20 time: 0.238264 Apr 14 16:14:03.712003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 241/479] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:03 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1745 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:03.998533 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7efe31dd-e29d-4e17-8dd3-54a6f9299baf tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:04.007955 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7efe31dd-e29d-4e17-8dd3-54a6f9299baf tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.372725 Apr 14 16:14:04.008579 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 239/480] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:03 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:04.731992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4b6e98ca-0450-454a-a519-ef1e3bce7cb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:04.732854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4b6e98ca-0450-454a-a519-ef1e3bce7cb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:04.740833 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4b6e98ca-0450-454a-a519-ef1e3bce7cb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:04.741398 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4b6e98ca-0450-454a-a519-ef1e3bce7cb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:04.742237 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4b6e98ca-0450-454a-a519-ef1e3bce7cb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:04.742723 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4b6e98ca-0450-454a-a519-ef1e3bce7cb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:04.944644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4b6e98ca-0450-454a-a519-ef1e3bce7cb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:04.954766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4b6e98ca-0450-454a-a519-ef1e3bce7cb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:04.956431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4b6e98ca-0450-454a-a519-ef1e3bce7cb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:04.957692 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4b6e98ca-0450-454a-a519-ef1e3bce7cb2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1745 microversion: 2.20 time: 0.231224 Apr 14 16:14:04.958300 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 242/481] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:04 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1745 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:05.027289 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-dac0102b-db73-4ae6-bb01-6a69c710e863 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:05.028129 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-dac0102b-db73-4ae6-bb01-6a69c710e863 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:05.036019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dac0102b-db73-4ae6-bb01-6a69c710e863 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:05.036531 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dac0102b-db73-4ae6-bb01-6a69c710e863 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:05.037505 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dac0102b-db73-4ae6-bb01-6a69c710e863 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:05.037878 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dac0102b-db73-4ae6-bb01-6a69c710e863 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:05.188035 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c9493adb-add9-4903-be64-63ad202ccc19 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:05.189464 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c9493adb-add9-4903-be64-63ad202ccc19 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:05.197432 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9493adb-add9-4903-be64-63ad202ccc19 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:05.197871 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9493adb-add9-4903-be64-63ad202ccc19 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:05.198782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9493adb-add9-4903-be64-63ad202ccc19 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:05.199285 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9493adb-add9-4903-be64-63ad202ccc19 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:05.269563 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-c9493adb-add9-4903-be64-63ad202ccc19 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lazy-loading 'flavor' on Instance uuid 0a704e48-ff08-4961-9c93-7a0fdf04543d {{(pid=99335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:14:05.270105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-dac0102b-db73-4ae6-bb01-6a69c710e863 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:05.281404 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-dac0102b-db73-4ae6-bb01-6a69c710e863 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.257920 Apr 14 16:14:05.282391 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 240/482] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:05 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:05.526992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c9493adb-add9-4903-be64-63ad202ccc19 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "POST /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/action" status: 200 len: 32 microversion: 2.1 time: 0.343368 Apr 14 16:14:05.527666 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 243/483] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:14:05 2021] POST /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/action => generated 32 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:14:05.537633 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f18440ec-ad1f-4667-ae0d-28098c91ed9f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:05.538306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f18440ec-ad1f-4667-ae0d-28098c91ed9f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:05.546943 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f18440ec-ad1f-4667-ae0d-28098c91ed9f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:05.547450 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f18440ec-ad1f-4667-ae0d-28098c91ed9f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:05.548293 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f18440ec-ad1f-4667-ae0d-28098c91ed9f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:05.548790 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f18440ec-ad1f-4667-ae0d-28098c91ed9f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:05.749412 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f18440ec-ad1f-4667-ae0d-28098c91ed9f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:05.758912 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f18440ec-ad1f-4667-ae0d-28098c91ed9f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.225578 Apr 14 16:14:05.759529 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 241/484] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:05 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:05.978723 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-19c8cd00-4715-4fbd-a20c-1c602bccbe34 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:05.979631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-19c8cd00-4715-4fbd-a20c-1c602bccbe34 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:05.988724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19c8cd00-4715-4fbd-a20c-1c602bccbe34 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:05.989263 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19c8cd00-4715-4fbd-a20c-1c602bccbe34 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:05.990095 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19c8cd00-4715-4fbd-a20c-1c602bccbe34 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:05.990584 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19c8cd00-4715-4fbd-a20c-1c602bccbe34 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:06.303898 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-12339979-f289-472e-a60a-8dd8b7c6d348 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:06.305015 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-12339979-f289-472e-a60a-8dd8b7c6d348 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:06.312992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-12339979-f289-472e-a60a-8dd8b7c6d348 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:06.313560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-12339979-f289-472e-a60a-8dd8b7c6d348 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:06.314411 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-12339979-f289-472e-a60a-8dd8b7c6d348 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:06.314901 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-12339979-f289-472e-a60a-8dd8b7c6d348 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:06.322610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-19c8cd00-4715-4fbd-a20c-1c602bccbe34 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:06.338434 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-19c8cd00-4715-4fbd-a20c-1c602bccbe34 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:06.341503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-19c8cd00-4715-4fbd-a20c-1c602bccbe34 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:06.343121 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-19c8cd00-4715-4fbd-a20c-1c602bccbe34 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1745 microversion: 2.20 time: 0.368949 Apr 14 16:14:06.343951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 244/485] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:05 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1745 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:06.531407 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-12339979-f289-472e-a60a-8dd8b7c6d348 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:06.545007 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-12339979-f289-472e-a60a-8dd8b7c6d348 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.248969 Apr 14 16:14:06.545965 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 242/486] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:06 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:06.596998 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-37e9f011-f60b-4d82-87fe-38a56abe56d0 req-3bd9a2ca-e411-431b-ba53-ee79f64ffc36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e83f61-2715-436f-8d7c-88c4483cc0e5", "name": "network-vif-plugged", "status": "completed", "tag": "d74de9c1-8188-4d05-92fc-6cdce0aa2e31"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:06.598992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:14:06.598992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:14:06.608944 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-37e9f011-f60b-4d82-87fe-38a56abe56d0 req-3bd9a2ca-e411-431b-ba53-ee79f64ffc36 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:06.609550 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-37e9f011-f60b-4d82-87fe-38a56abe56d0 req-3bd9a2ca-e411-431b-ba53-ee79f64ffc36 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:06.628170 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-37e9f011-f60b-4d82-87fe-38a56abe56d0 req-3bd9a2ca-e411-431b-ba53-ee79f64ffc36 service nova] Creating event network-vif-plugged:d74de9c1-8188-4d05-92fc-6cdce0aa2e31 for instance 97e83f61-2715-436f-8d7c-88c4483cc0e5 on hv-cinder-78626 Apr 14 16:14:06.633237 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-37e9f011-f60b-4d82-87fe-38a56abe56d0 req-3bd9a2ca-e411-431b-ba53-ee79f64ffc36 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040319 Apr 14 16:14:06.633895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 245/487] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:14:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:14:06.779558 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-68f9b73a-f5c3-4065-9ccf-13b67c493dc1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:06.780146 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-68f9b73a-f5c3-4065-9ccf-13b67c493dc1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:06.788262 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-68f9b73a-f5c3-4065-9ccf-13b67c493dc1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:06.788766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-68f9b73a-f5c3-4065-9ccf-13b67c493dc1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:06.789665 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-68f9b73a-f5c3-4065-9ccf-13b67c493dc1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:06.790156 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-68f9b73a-f5c3-4065-9ccf-13b67c493dc1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:06.989323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-68f9b73a-f5c3-4065-9ccf-13b67c493dc1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:06.998626 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-68f9b73a-f5c3-4065-9ccf-13b67c493dc1 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.224474 Apr 14 16:14:06.999243 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 243/488] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:06 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:07.363403 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-22e02941-420a-425e-b524-36733b07f268 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:07.364445 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-22e02941-420a-425e-b524-36733b07f268 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:07.373439 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-22e02941-420a-425e-b524-36733b07f268 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:07.373942 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-22e02941-420a-425e-b524-36733b07f268 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:07.374903 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-22e02941-420a-425e-b524-36733b07f268 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:07.375561 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-22e02941-420a-425e-b524-36733b07f268 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:07.564861 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bdba1983-edde-47fc-8625-b086755d74f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:07.565537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bdba1983-edde-47fc-8625-b086755d74f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:07.574450 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdba1983-edde-47fc-8625-b086755d74f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:07.574950 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdba1983-edde-47fc-8625-b086755d74f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:07.576296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdba1983-edde-47fc-8625-b086755d74f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:07.576977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdba1983-edde-47fc-8625-b086755d74f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:07.582022 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-22e02941-420a-425e-b524-36733b07f268 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:07.592089 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-22e02941-420a-425e-b524-36733b07f268 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:07.593944 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-22e02941-420a-425e-b524-36733b07f268 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:07.595282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-22e02941-420a-425e-b524-36733b07f268 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1740 microversion: 2.20 time: 0.236473 Apr 14 16:14:07.596182 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 246/489] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:07 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:07.789012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bdba1983-edde-47fc-8625-b086755d74f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:07.799040 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bdba1983-edde-47fc-8625-b086755d74f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.238326 Apr 14 16:14:07.799669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 244/490] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:07 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:08.017592 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-71402151-d095-45dd-821b-b504677b1eac tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:08.018311 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-71402151-d095-45dd-821b-b504677b1eac tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:08.026519 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-71402151-d095-45dd-821b-b504677b1eac tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:08.027665 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-71402151-d095-45dd-821b-b504677b1eac tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:08.028516 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-71402151-d095-45dd-821b-b504677b1eac tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:08.029008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-71402151-d095-45dd-821b-b504677b1eac tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:08.243086 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-71402151-d095-45dd-821b-b504677b1eac tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:08.252899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-71402151-d095-45dd-821b-b504677b1eac tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.239361 Apr 14 16:14:08.253554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 247/491] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:08 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:08.515866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-72f18c62-aaee-45b6-b9c8-5412e4b8e414 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:08.516416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-72f18c62-aaee-45b6-b9c8-5412e4b8e414 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:08.524350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-72f18c62-aaee-45b6-b9c8-5412e4b8e414 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:08.524842 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-72f18c62-aaee-45b6-b9c8-5412e4b8e414 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:08.525706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-72f18c62-aaee-45b6-b9c8-5412e4b8e414 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:08.526193 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-72f18c62-aaee-45b6-b9c8-5412e4b8e414 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:08.600041 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-72f18c62-aaee-45b6-b9c8-5412e4b8e414 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Going to try to terminate instance {{(pid=99334) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:14:08.615629 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f646e051-691b-44d9-8e52-de629b3e1b0c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:08.616296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f646e051-691b-44d9-8e52-de629b3e1b0c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:08.625142 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f646e051-691b-44d9-8e52-de629b3e1b0c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:08.625726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f646e051-691b-44d9-8e52-de629b3e1b0c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:08.626806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f646e051-691b-44d9-8e52-de629b3e1b0c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:08.627303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f646e051-691b-44d9-8e52-de629b3e1b0c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:08.739228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-72f18c62-aaee-45b6-b9c8-5412e4b8e414 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "DELETE /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 204 len: 0 microversion: 2.1 time: 0.227941 Apr 14 16:14:08.740360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 245/492] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:14:08 2021] DELETE /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:14:08.751617 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5ecac499-e2aa-4098-ac96-a42425c1278b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:08.752822 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5ecac499-e2aa-4098-ac96-a42425c1278b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:08.762554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5ecac499-e2aa-4098-ac96-a42425c1278b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:08.763280 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5ecac499-e2aa-4098-ac96-a42425c1278b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:08.764362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5ecac499-e2aa-4098-ac96-a42425c1278b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:08.764995 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5ecac499-e2aa-4098-ac96-a42425c1278b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:08.888727 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f646e051-691b-44d9-8e52-de629b3e1b0c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:08.900274 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f646e051-691b-44d9-8e52-de629b3e1b0c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:08.902557 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f646e051-691b-44d9-8e52-de629b3e1b0c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:08.903808 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f646e051-691b-44d9-8e52-de629b3e1b0c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1740 microversion: 2.20 time: 0.292490 Apr 14 16:14:08.904426 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 248/493] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:08 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:14:08.909879 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-724974f7-e77c-44de-b87d-a608f5d05c05 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:08.911482 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-724974f7-e77c-44de-b87d-a608f5d05c05 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:08.920972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-724974f7-e77c-44de-b87d-a608f5d05c05 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:08.921518 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-724974f7-e77c-44de-b87d-a608f5d05c05 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:08.922375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-724974f7-e77c-44de-b87d-a608f5d05c05 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:08.922874 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-724974f7-e77c-44de-b87d-a608f5d05c05 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:08.991242 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5ecac499-e2aa-4098-ac96-a42425c1278b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:09.012930 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5ecac499-e2aa-4098-ac96-a42425c1278b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1513 microversion: 2.1 time: 0.267635 Apr 14 16:14:09.013623 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 246/494] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:08 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1513 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:09.141511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-724974f7-e77c-44de-b87d-a608f5d05c05 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:09.151330 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-724974f7-e77c-44de-b87d-a608f5d05c05 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.245595 Apr 14 16:14:09.152525 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 249/495] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:08 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:09.271727 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-59decd2c-a1a7-4c5f-a008-8f470371c76f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:09.272442 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-59decd2c-a1a7-4c5f-a008-8f470371c76f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:09.281865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59decd2c-a1a7-4c5f-a008-8f470371c76f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:09.282618 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59decd2c-a1a7-4c5f-a008-8f470371c76f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:09.283780 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59decd2c-a1a7-4c5f-a008-8f470371c76f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:09.284351 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59decd2c-a1a7-4c5f-a008-8f470371c76f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:09.506567 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-59decd2c-a1a7-4c5f-a008-8f470371c76f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:09.518335 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-59decd2c-a1a7-4c5f-a008-8f470371c76f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.250714 Apr 14 16:14:09.520928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 247/496] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:09 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:09.925461 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9134c636-9a07-470f-bb4b-3bdf0a862046 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:09.926509 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9134c636-9a07-470f-bb4b-3bdf0a862046 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:09.937752 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9134c636-9a07-470f-bb4b-3bdf0a862046 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:09.938382 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9134c636-9a07-470f-bb4b-3bdf0a862046 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:09.939238 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9134c636-9a07-470f-bb4b-3bdf0a862046 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:09.939727 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9134c636-9a07-470f-bb4b-3bdf0a862046 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:10.036571 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3457f0a8-e1df-49e4-8eec-e5f653ae7555 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:10.038443 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3457f0a8-e1df-49e4-8eec-e5f653ae7555 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:10.052358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3457f0a8-e1df-49e4-8eec-e5f653ae7555 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:10.056099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3457f0a8-e1df-49e4-8eec-e5f653ae7555 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:10.057217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3457f0a8-e1df-49e4-8eec-e5f653ae7555 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:10.058691 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3457f0a8-e1df-49e4-8eec-e5f653ae7555 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:10.310289 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3457f0a8-e1df-49e4-8eec-e5f653ae7555 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:10.332583 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3457f0a8-e1df-49e4-8eec-e5f653ae7555 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1513 microversion: 2.1 time: 0.305092 Apr 14 16:14:10.333381 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 248/497] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:10 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1513 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:10.345204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a4733875-03e2-47ff-a017-846e8c9d6bf9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:10.345204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a4733875-03e2-47ff-a017-846e8c9d6bf9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:10.351582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4733875-03e2-47ff-a017-846e8c9d6bf9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:10.352212 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4733875-03e2-47ff-a017-846e8c9d6bf9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:10.353275 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4733875-03e2-47ff-a017-846e8c9d6bf9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:10.353963 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4733875-03e2-47ff-a017-846e8c9d6bf9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:10.435159 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9134c636-9a07-470f-bb4b-3bdf0a862046 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:10.445756 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9134c636-9a07-470f-bb4b-3bdf0a862046 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:10.447752 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9134c636-9a07-470f-bb4b-3bdf0a862046 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:10.449624 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9134c636-9a07-470f-bb4b-3bdf0a862046 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1740 microversion: 2.20 time: 0.528843 Apr 14 16:14:10.450855 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 250/498] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:09 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1740 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:10.538760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e3ffd308-fdd1-49df-a7ec-6c90c71f4ac2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:10.539791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e3ffd308-fdd1-49df-a7ec-6c90c71f4ac2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:10.548765 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e3ffd308-fdd1-49df-a7ec-6c90c71f4ac2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:10.549481 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e3ffd308-fdd1-49df-a7ec-6c90c71f4ac2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:10.550515 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e3ffd308-fdd1-49df-a7ec-6c90c71f4ac2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:10.551249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e3ffd308-fdd1-49df-a7ec-6c90c71f4ac2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:10.618368 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a4733875-03e2-47ff-a017-846e8c9d6bf9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:10.628593 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a4733875-03e2-47ff-a017-846e8c9d6bf9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.294040 Apr 14 16:14:10.629487 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 249/499] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:10 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:10.777282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e3ffd308-fdd1-49df-a7ec-6c90c71f4ac2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:10.792133 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e3ffd308-fdd1-49df-a7ec-6c90c71f4ac2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.257410 Apr 14 16:14:10.796340 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 251/500] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:10 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:11.352521 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-86bcdee9-9594-4c56-adc7-6e689257f645 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:11.353394 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-86bcdee9-9594-4c56-adc7-6e689257f645 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:11.365557 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-86bcdee9-9594-4c56-adc7-6e689257f645 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:11.366170 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-86bcdee9-9594-4c56-adc7-6e689257f645 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:11.369145 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-86bcdee9-9594-4c56-adc7-6e689257f645 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:11.369145 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-86bcdee9-9594-4c56-adc7-6e689257f645 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:11.472738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-968bd629-6f6c-4f06-9933-e6195f01fb25 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:11.473594 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-968bd629-6f6c-4f06-9933-e6195f01fb25 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:11.484712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-968bd629-6f6c-4f06-9933-e6195f01fb25 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:11.485253 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-968bd629-6f6c-4f06-9933-e6195f01fb25 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:11.486113 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-968bd629-6f6c-4f06-9933-e6195f01fb25 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:11.486604 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-968bd629-6f6c-4f06-9933-e6195f01fb25 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:11.587918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-86bcdee9-9594-4c56-adc7-6e689257f645 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:11.600859 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-86bcdee9-9594-4c56-adc7-6e689257f645 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1513 microversion: 2.1 time: 0.252532 Apr 14 16:14:11.601783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 250/501] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:11 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:11.648723 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a14a7429-b0d9-404a-9101-d451967bfa54 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:11.650630 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a14a7429-b0d9-404a-9101-d451967bfa54 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:11.665603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a14a7429-b0d9-404a-9101-d451967bfa54 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:11.666811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a14a7429-b0d9-404a-9101-d451967bfa54 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:11.668815 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a14a7429-b0d9-404a-9101-d451967bfa54 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:11.669593 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a14a7429-b0d9-404a-9101-d451967bfa54 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:11.741515 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-968bd629-6f6c-4f06-9933-e6195f01fb25 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:11.758250 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-968bd629-6f6c-4f06-9933-e6195f01fb25 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:11.760951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-968bd629-6f6c-4f06-9933-e6195f01fb25 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:11.766232 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-968bd629-6f6c-4f06-9933-e6195f01fb25 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1740 microversion: 2.20 time: 0.297865 Apr 14 16:14:11.767160 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 252/502] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:11 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1740 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:14:11.814045 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d600ac21-0344-48a1-80b3-cb1977a4acf6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:11.814718 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d600ac21-0344-48a1-80b3-cb1977a4acf6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:11.828432 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d600ac21-0344-48a1-80b3-cb1977a4acf6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:11.828948 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d600ac21-0344-48a1-80b3-cb1977a4acf6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:11.829882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d600ac21-0344-48a1-80b3-cb1977a4acf6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:11.830366 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d600ac21-0344-48a1-80b3-cb1977a4acf6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:11.963131 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a14a7429-b0d9-404a-9101-d451967bfa54 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:11.974967 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a14a7429-b0d9-404a-9101-d451967bfa54 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.330869 Apr 14 16:14:11.975813 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 251/503] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:11 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:12.169519 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d600ac21-0344-48a1-80b3-cb1977a4acf6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:12.179193 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d600ac21-0344-48a1-80b3-cb1977a4acf6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.369333 Apr 14 16:14:12.187549 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 253/504] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:11 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:12.620196 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-227d4fd1-fe50-44bc-9dc1-16e628d0f7d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:12.621469 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-227d4fd1-fe50-44bc-9dc1-16e628d0f7d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:12.630028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-227d4fd1-fe50-44bc-9dc1-16e628d0f7d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:12.630547 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-227d4fd1-fe50-44bc-9dc1-16e628d0f7d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:12.631416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-227d4fd1-fe50-44bc-9dc1-16e628d0f7d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:12.631918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-227d4fd1-fe50-44bc-9dc1-16e628d0f7d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:12.788284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-44ab1dc5-c718-4e73-aa8f-d63b8d8965d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:12.789283 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-44ab1dc5-c718-4e73-aa8f-d63b8d8965d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:12.799636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44ab1dc5-c718-4e73-aa8f-d63b8d8965d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:12.799867 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44ab1dc5-c718-4e73-aa8f-d63b8d8965d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:12.801545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44ab1dc5-c718-4e73-aa8f-d63b8d8965d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:12.801746 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44ab1dc5-c718-4e73-aa8f-d63b8d8965d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:12.871968 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-227d4fd1-fe50-44bc-9dc1-16e628d0f7d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:12.882572 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-227d4fd1-fe50-44bc-9dc1-16e628d0f7d4 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1513 microversion: 2.1 time: 0.266550 Apr 14 16:14:12.885972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 252/505] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:12 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1513 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:12.996871 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0518ee82-1bf7-4f3e-82db-c10d54970e39 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:12.998096 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0518ee82-1bf7-4f3e-82db-c10d54970e39 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:13.009925 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0518ee82-1bf7-4f3e-82db-c10d54970e39 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:13.010695 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0518ee82-1bf7-4f3e-82db-c10d54970e39 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:13.012104 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0518ee82-1bf7-4f3e-82db-c10d54970e39 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:13.012606 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0518ee82-1bf7-4f3e-82db-c10d54970e39 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:13.064534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-44ab1dc5-c718-4e73-aa8f-d63b8d8965d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:13.079899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-44ab1dc5-c718-4e73-aa8f-d63b8d8965d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:13.083043 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-44ab1dc5-c718-4e73-aa8f-d63b8d8965d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:13.084835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-44ab1dc5-c718-4e73-aa8f-d63b8d8965d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1740 microversion: 2.20 time: 0.301156 Apr 14 16:14:13.085921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 254/506] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:12 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:13.200460 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-85cdd8f5-cde1-4177-8f82-14344dda037c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:13.201185 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-85cdd8f5-cde1-4177-8f82-14344dda037c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:13.211538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85cdd8f5-cde1-4177-8f82-14344dda037c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:13.212048 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85cdd8f5-cde1-4177-8f82-14344dda037c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:13.212912 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85cdd8f5-cde1-4177-8f82-14344dda037c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:13.213448 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85cdd8f5-cde1-4177-8f82-14344dda037c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:13.345445 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0518ee82-1bf7-4f3e-82db-c10d54970e39 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:13.356456 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0518ee82-1bf7-4f3e-82db-c10d54970e39 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.362900 Apr 14 16:14:13.365624 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 253/507] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:12 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:13.630009 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-85cdd8f5-cde1-4177-8f82-14344dda037c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:13.643534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-85cdd8f5-cde1-4177-8f82-14344dda037c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.449149 Apr 14 16:14:13.644209 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 255/508] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:13 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:13.912345 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-eee7668b-3067-4f20-b03a-7d9bcd2be3dd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:13.913210 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-eee7668b-3067-4f20-b03a-7d9bcd2be3dd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:13.922838 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eee7668b-3067-4f20-b03a-7d9bcd2be3dd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:13.923451 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eee7668b-3067-4f20-b03a-7d9bcd2be3dd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:13.924572 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eee7668b-3067-4f20-b03a-7d9bcd2be3dd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:13.925182 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eee7668b-3067-4f20-b03a-7d9bcd2be3dd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:14.107128 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fbde1373-7cb8-41a0-a67a-abbdb34e72d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:14.108053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fbde1373-7cb8-41a0-a67a-abbdb34e72d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:14.126833 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fbde1373-7cb8-41a0-a67a-abbdb34e72d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:14.130869 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fbde1373-7cb8-41a0-a67a-abbdb34e72d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:14.132770 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fbde1373-7cb8-41a0-a67a-abbdb34e72d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:14.133535 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fbde1373-7cb8-41a0-a67a-abbdb34e72d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:14.164833 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-eee7668b-3067-4f20-b03a-7d9bcd2be3dd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:14.175239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-eee7668b-3067-4f20-b03a-7d9bcd2be3dd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1513 microversion: 2.1 time: 0.266738 Apr 14 16:14:14.186617 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 254/509] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:13 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:14.376979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8469cced-d33b-431d-ad63-3934cf241968 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:14.377663 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8469cced-d33b-431d-ad63-3934cf241968 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:14.403100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8469cced-d33b-431d-ad63-3934cf241968 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:14.403613 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8469cced-d33b-431d-ad63-3934cf241968 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:14.404484 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8469cced-d33b-431d-ad63-3934cf241968 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:14.404985 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8469cced-d33b-431d-ad63-3934cf241968 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:14.571678 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fbde1373-7cb8-41a0-a67a-abbdb34e72d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:14.582217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fbde1373-7cb8-41a0-a67a-abbdb34e72d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:14.583833 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fbde1373-7cb8-41a0-a67a-abbdb34e72d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:14.585100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fbde1373-7cb8-41a0-a67a-abbdb34e72d4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1740 microversion: 2.20 time: 0.485156 Apr 14 16:14:14.598091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 256/510] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:14 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1740 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:14.647088 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8469cced-d33b-431d-ad63-3934cf241968 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:14.658872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8469cced-d33b-431d-ad63-3934cf241968 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.284948 Apr 14 16:14:14.665137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f8dcde83-9a3c-4882-893f-a18200d5d8e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:14.666072 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f8dcde83-9a3c-4882-893f-a18200d5d8e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:14.671316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 255/511] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:14 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:14.676821 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f8dcde83-9a3c-4882-893f-a18200d5d8e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:14.677465 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f8dcde83-9a3c-4882-893f-a18200d5d8e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:14.678404 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f8dcde83-9a3c-4882-893f-a18200d5d8e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:14.678977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f8dcde83-9a3c-4882-893f-a18200d5d8e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:14.716274 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-ba8a65e6-bd99-4cb7-86d7-f3b3b55fb9db req-731ecb9a-28de-4ba2-a72d-20fa9a9ab024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304001e9-ca53-4ab3-be25-483e56e3b857", "name": "network-vif-deleted", "tag": "e07ec31c-d9ac-4532-b2dd-5c2caeafaf57"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:14.721073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:14:14.721073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:14:14.731424 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-ba8a65e6-bd99-4cb7-86d7-f3b3b55fb9db req-731ecb9a-28de-4ba2-a72d-20fa9a9ab024 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:14.732158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-ba8a65e6-bd99-4cb7-86d7-f3b3b55fb9db req-731ecb9a-28de-4ba2-a72d-20fa9a9ab024 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:14.751466 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-ba8a65e6-bd99-4cb7-86d7-f3b3b55fb9db req-731ecb9a-28de-4ba2-a72d-20fa9a9ab024 service nova] Creating event network-vif-deleted:e07ec31c-d9ac-4532-b2dd-5c2caeafaf57 for instance 304001e9-ca53-4ab3-be25-483e56e3b857 on hv-cinder-78626 Apr 14 16:14:14.758439 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-ba8a65e6-bd99-4cb7-86d7-f3b3b55fb9db req-731ecb9a-28de-4ba2-a72d-20fa9a9ab024 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050438 Apr 14 16:14:14.759287 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 256/512] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:14:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:14:14.891197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f8dcde83-9a3c-4882-893f-a18200d5d8e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:14.903484 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f8dcde83-9a3c-4882-893f-a18200d5d8e3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.243013 Apr 14 16:14:14.904419 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 257/513] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:14 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:15.194508 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-02becde4-b2a6-4c04-ac11-151e9dc60d43 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:15.195275 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-02becde4-b2a6-4c04-ac11-151e9dc60d43 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:15.203820 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-02becde4-b2a6-4c04-ac11-151e9dc60d43 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:15.204328 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-02becde4-b2a6-4c04-ac11-151e9dc60d43 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:15.205194 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-02becde4-b2a6-4c04-ac11-151e9dc60d43 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:15.205689 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-02becde4-b2a6-4c04-ac11-151e9dc60d43 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:15.284350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-02becde4-b2a6-4c04-ac11-151e9dc60d43 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:15.284849 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-02becde4-b2a6-4c04-ac11-151e9dc60d43 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:15.285383 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-02becde4-b2a6-4c04-ac11-151e9dc60d43 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lazy-loading 'fault' on Instance uuid 304001e9-ca53-4ab3-be25-483e56e3b857 {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:14:15.356459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-02becde4-b2a6-4c04-ac11-151e9dc60d43 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:15.366423 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-02becde4-b2a6-4c04-ac11-151e9dc60d43 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 200 len: 1308 microversion: 2.1 time: 0.176525 Apr 14 16:14:15.367075 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 257/514] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:15 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:15.610091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-00dec48b-7de6-4929-92d4-2d6fca8e5b17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:15.610907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-00dec48b-7de6-4929-92d4-2d6fca8e5b17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:15.623053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00dec48b-7de6-4929-92d4-2d6fca8e5b17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:15.623811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00dec48b-7de6-4929-92d4-2d6fca8e5b17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:15.625196 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00dec48b-7de6-4929-92d4-2d6fca8e5b17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:15.625905 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00dec48b-7de6-4929-92d4-2d6fca8e5b17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:15.680859 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-14b43d4d-3fe9-4ce5-9200-8dcb207e16ac tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:15.681855 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-14b43d4d-3fe9-4ce5-9200-8dcb207e16ac tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:15.689893 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-14b43d4d-3fe9-4ce5-9200-8dcb207e16ac tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:15.690401 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-14b43d4d-3fe9-4ce5-9200-8dcb207e16ac tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:15.691247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-14b43d4d-3fe9-4ce5-9200-8dcb207e16ac tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:15.691736 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-14b43d4d-3fe9-4ce5-9200-8dcb207e16ac tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:15.991123 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-00dec48b-7de6-4929-92d4-2d6fca8e5b17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:16.008956 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-00dec48b-7de6-4929-92d4-2d6fca8e5b17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:16.010571 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-14b43d4d-3fe9-4ce5-9200-8dcb207e16ac tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:16.012366 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-00dec48b-7de6-4929-92d4-2d6fca8e5b17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:16.014525 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-00dec48b-7de6-4929-92d4-2d6fca8e5b17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1740 microversion: 2.20 time: 0.413147 Apr 14 16:14:16.015716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 258/515] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:15 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:16.021911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c2192b53-d931-4081-b5af-dd13fcd44126 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:16.023086 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c2192b53-d931-4081-b5af-dd13fcd44126 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:16.035271 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c2192b53-d931-4081-b5af-dd13fcd44126 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:16.036045 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-14b43d4d-3fe9-4ce5-9200-8dcb207e16ac tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.361482 Apr 14 16:14:16.041306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c2192b53-d931-4081-b5af-dd13fcd44126 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:16.041438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 258/516] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:15 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:16.041565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c2192b53-d931-4081-b5af-dd13fcd44126 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:16.041565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c2192b53-d931-4081-b5af-dd13fcd44126 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:16.317661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c2192b53-d931-4081-b5af-dd13fcd44126 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:16.327803 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c2192b53-d931-4081-b5af-dd13fcd44126 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.310713 Apr 14 16:14:16.328556 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 259/517] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:16 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:16.385556 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-49311bdc-b006-438b-8a97-5be5f8b4faf2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:16.387076 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-49311bdc-b006-438b-8a97-5be5f8b4faf2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 304001e9-ca53-4ab3-be25-483e56e3b857] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:16.404188 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49311bdc-b006-438b-8a97-5be5f8b4faf2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:16.404819 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49311bdc-b006-438b-8a97-5be5f8b4faf2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:16.405805 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49311bdc-b006-438b-8a97-5be5f8b4faf2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:16.406371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49311bdc-b006-438b-8a97-5be5f8b4faf2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:16.481097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-49311bdc-b006-438b-8a97-5be5f8b4faf2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] HTTP exception thrown: Instance 304001e9-ca53-4ab3-be25-483e56e3b857 could not be found. Apr 14 16:14:16.481097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-49311bdc-b006-438b-8a97-5be5f8b4faf2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Returning 404 to user: Instance 304001e9-ca53-4ab3-be25-483e56e3b857 could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:14:16.481526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-49311bdc-b006-438b-8a97-5be5f8b4faf2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857" status: 404 len: 111 microversion: 2.1 time: 0.100142 Apr 14 16:14:16.482152 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 259/518] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:16 2021] GET /compute/v2.1/servers/304001e9-ca53-4ab3-be25-483e56e3b857 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:14:17.040663 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-507b2b5b-907b-42a3-908f-24bcc9438bcb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:17.041730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-507b2b5b-907b-42a3-908f-24bcc9438bcb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:17.059757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4aee40c9-3a6f-455b-b547-0b05fcaeb613 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:17.060811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4aee40c9-3a6f-455b-b547-0b05fcaeb613 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:17.070298 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4aee40c9-3a6f-455b-b547-0b05fcaeb613 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:17.070523 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-507b2b5b-907b-42a3-908f-24bcc9438bcb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:17.071286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4aee40c9-3a6f-455b-b547-0b05fcaeb613 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:17.071462 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-507b2b5b-907b-42a3-908f-24bcc9438bcb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:17.072455 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4aee40c9-3a6f-455b-b547-0b05fcaeb613 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:17.072673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-507b2b5b-907b-42a3-908f-24bcc9438bcb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:17.073377 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4aee40c9-3a6f-455b-b547-0b05fcaeb613 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:17.073988 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-507b2b5b-907b-42a3-908f-24bcc9438bcb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:17.338132 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4aee40c9-3a6f-455b-b547-0b05fcaeb613 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:17.350544 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4aee40c9-3a6f-455b-b547-0b05fcaeb613 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.297004 Apr 14 16:14:17.353707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-507b2b5b-907b-42a3-908f-24bcc9438bcb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:17.363364 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-507b2b5b-907b-42a3-908f-24bcc9438bcb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:17.366369 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-507b2b5b-907b-42a3-908f-24bcc9438bcb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:17.366369 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-507b2b5b-907b-42a3-908f-24bcc9438bcb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1740 microversion: 2.20 time: 0.331106 Apr 14 16:14:17.366979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 260/519] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:17 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1740 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:17.369184 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 260/520] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:17 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:17.372337 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e090e884-4efc-48af-9361-e29c1c2419ff tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:17.372999 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e090e884-4efc-48af-9361-e29c1c2419ff tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:17.380889 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e090e884-4efc-48af-9361-e29c1c2419ff tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:17.381421 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e090e884-4efc-48af-9361-e29c1c2419ff tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:17.382273 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e090e884-4efc-48af-9361-e29c1c2419ff tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:17.382761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e090e884-4efc-48af-9361-e29c1c2419ff tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:17.587200 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e090e884-4efc-48af-9361-e29c1c2419ff tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:17.597330 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e090e884-4efc-48af-9361-e29c1c2419ff tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.229191 Apr 14 16:14:17.597996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 261/521] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:17 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:17.872169 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-475bb1d3-c39a-4d52-a064-79b459d4eb5a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:17.872725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-475bb1d3-c39a-4d52-a064-79b459d4eb5a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:17.880594 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-475bb1d3-c39a-4d52-a064-79b459d4eb5a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:17.881137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-475bb1d3-c39a-4d52-a064-79b459d4eb5a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:17.881978 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-475bb1d3-c39a-4d52-a064-79b459d4eb5a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:17.882473 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-475bb1d3-c39a-4d52-a064-79b459d4eb5a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:17.956654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-475bb1d3-c39a-4d52-a064-79b459d4eb5a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Going to try to terminate instance {{(pid=99334) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:14:18.086579 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-475bb1d3-c39a-4d52-a064-79b459d4eb5a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 204 len: 0 microversion: 2.1 time: 0.218674 Apr 14 16:14:18.091763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 261/522] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:14:17 2021] DELETE /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:14:18.096536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1798e987-edfb-4f06-8418-12a7ae1475f2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:18.097276 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1798e987-edfb-4f06-8418-12a7ae1475f2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:18.110234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1798e987-edfb-4f06-8418-12a7ae1475f2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:18.111227 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1798e987-edfb-4f06-8418-12a7ae1475f2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:18.112309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1798e987-edfb-4f06-8418-12a7ae1475f2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:18.113192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1798e987-edfb-4f06-8418-12a7ae1475f2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:18.373756 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3f9957cc-ef9f-4c87-9a76-e5b164b531b2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:18.374520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3f9957cc-ef9f-4c87-9a76-e5b164b531b2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:18.382938 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3f9957cc-ef9f-4c87-9a76-e5b164b531b2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:18.383444 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3f9957cc-ef9f-4c87-9a76-e5b164b531b2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:18.384284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3f9957cc-ef9f-4c87-9a76-e5b164b531b2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:18.386538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3f9957cc-ef9f-4c87-9a76-e5b164b531b2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:18.390161 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1798e987-edfb-4f06-8418-12a7ae1475f2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:18.399368 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1798e987-edfb-4f06-8418-12a7ae1475f2 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1513 microversion: 2.1 time: 0.306841 Apr 14 16:14:18.400213 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 262/523] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:18 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1513 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:18.415198 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-429acff9-bf62-46e2-a4d2-9521a38c18aa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:18.415865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-429acff9-bf62-46e2-a4d2-9521a38c18aa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:18.426253 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-429acff9-bf62-46e2-a4d2-9521a38c18aa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:18.426767 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-429acff9-bf62-46e2-a4d2-9521a38c18aa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:18.427627 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-429acff9-bf62-46e2-a4d2-9521a38c18aa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:18.428138 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-429acff9-bf62-46e2-a4d2-9521a38c18aa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:18.600718 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3f9957cc-ef9f-4c87-9a76-e5b164b531b2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:18.611781 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3f9957cc-ef9f-4c87-9a76-e5b164b531b2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.243743 Apr 14 16:14:18.613806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 262/524] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:18 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:18.617768 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b07f4cab-737a-4865-8566-6cfdc0008202 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:18.618442 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b07f4cab-737a-4865-8566-6cfdc0008202 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:18.627744 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b07f4cab-737a-4865-8566-6cfdc0008202 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:18.628255 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b07f4cab-737a-4865-8566-6cfdc0008202 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:18.629141 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b07f4cab-737a-4865-8566-6cfdc0008202 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:18.629636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b07f4cab-737a-4865-8566-6cfdc0008202 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:18.698867 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-429acff9-bf62-46e2-a4d2-9521a38c18aa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:18.709089 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-429acff9-bf62-46e2-a4d2-9521a38c18aa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:18.710796 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-429acff9-bf62-46e2-a4d2-9521a38c18aa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:18.712048 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-429acff9-bf62-46e2-a4d2-9521a38c18aa tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1740 microversion: 2.20 time: 0.300869 Apr 14 16:14:18.726958 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 263/525] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:18 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1740 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:18.869197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b07f4cab-737a-4865-8566-6cfdc0008202 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:18.880374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b07f4cab-737a-4865-8566-6cfdc0008202 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.266380 Apr 14 16:14:18.892219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 263/526] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:18 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:19.181332 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-65704822", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-643900673", "security_groups": [{"name": "tempest-secgroup-smoke-944231262"}], "block_device_mapping_v2": [{"uuid": "a7d6301b-feed-44b8-8c11-9914455f829a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f231942-4227-4866-b347-c39ce3e77e17"}]}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:19.378756 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] validate_networks() for [('7f231942-4227-4866-b347-c39ce3e77e17', None, None, None)] {{(pid=99335) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:14:19.419329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8c4b7366-0b5e-4412-9ec5-1c2f31a6c636 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:19.420431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8c4b7366-0b5e-4412-9ec5-1c2f31a6c636 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:19.436829 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8c4b7366-0b5e-4412-9ec5-1c2f31a6c636 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:19.437649 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8c4b7366-0b5e-4412-9ec5-1c2f31a6c636 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:19.438738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8c4b7366-0b5e-4412-9ec5-1c2f31a6c636 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:19.439420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8c4b7366-0b5e-4412-9ec5-1c2f31a6c636 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:19.726752 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8c4b7366-0b5e-4412-9ec5-1c2f31a6c636 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:19.739111 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8c4b7366-0b5e-4412-9ec5-1c2f31a6c636 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1513 microversion: 2.1 time: 0.324813 Apr 14 16:14:19.739946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 264/527] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:19 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1513 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:19.744877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-71abaaad-16b2-439d-921f-b3f415226b73 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:19.746429 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-71abaaad-16b2-439d-921f-b3f415226b73 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:19.755731 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-71abaaad-16b2-439d-921f-b3f415226b73 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:19.755731 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-71abaaad-16b2-439d-921f-b3f415226b73 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:19.756855 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-71abaaad-16b2-439d-921f-b3f415226b73 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:19.757451 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-71abaaad-16b2-439d-921f-b3f415226b73 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:20.097632 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-71abaaad-16b2-439d-921f-b3f415226b73 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:20.113665 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-71abaaad-16b2-439d-921f-b3f415226b73 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.372291 Apr 14 16:14:20.114560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 265/528] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:19 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:20.131882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b7fe79d2-1fb6-44cd-a3a1-b574071b07fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:20.132730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b7fe79d2-1fb6-44cd-a3a1-b574071b07fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:20.142997 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b7fe79d2-1fb6-44cd-a3a1-b574071b07fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:20.143904 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b7fe79d2-1fb6-44cd-a3a1-b574071b07fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:20.144861 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b7fe79d2-1fb6-44cd-a3a1-b574071b07fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:20.145502 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b7fe79d2-1fb6-44cd-a3a1-b574071b07fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:20.349686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Flavor limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:14:20.350183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Image limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:14:20.350706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Flavor pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:14:20.351163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Image pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:14:20.351628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:14:20.362993 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:20.363718 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:20.364774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:20.365450 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:20.383971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b7fe79d2-1fb6-44cd-a3a1-b574071b07fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:20.386476 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Getting quotas for project ed9d2e253f144da0bf1bbc63b4657b81. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:14:20.391431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Getting quotas for user c9637a87d0cc41bb87b2437326c01992 and project ed9d2e253f144da0bf1bbc63b4657b81. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:14:20.394780 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b7fe79d2-1fb6-44cd-a3a1-b574071b07fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:20.396918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b7fe79d2-1fb6-44cd-a3a1-b574071b07fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:20.398323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b7fe79d2-1fb6-44cd-a3a1-b574071b07fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1740 microversion: 2.20 time: 0.270576 Apr 14 16:14:20.398801 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 266/529] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:20 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:20.407406 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-78546050-59b1-4cee-be82-db33d69ad695 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:20.408581 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-78546050-59b1-4cee-be82-db33d69ad695 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:20.418482 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-78546050-59b1-4cee-be82-db33d69ad695 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:20.420509 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-78546050-59b1-4cee-be82-db33d69ad695 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:20.421869 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-78546050-59b1-4cee-be82-db33d69ad695 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:20.422578 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-78546050-59b1-4cee-be82-db33d69ad695 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:20.520392 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Going to run 1 instances... {{(pid=99335) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:14:20.523044 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a7d6301b-feed-44b8-8c11-9914455f829a',volume_size=None,volume_type=None)] {{(pid=99335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:14:20.648072 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-78546050-59b1-4cee-be82-db33d69ad695 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:20.661073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-78546050-59b1-4cee-be82-db33d69ad695 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.257412 Apr 14 16:14:20.661803 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 267/530] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:20 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:20.733819 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3075555e-8994-4390-95b1-cac498d20896 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.556660 Apr 14 16:14:20.737219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 264/531] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:14:19 2021] POST /compute/v2.1/servers => generated 405 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:14:20.745281 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c395c3e4-8e29-468f-b350-d2de9166497e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:20.746707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c395c3e4-8e29-468f-b350-d2de9166497e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:20.760526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fe0f0460-f9c2-4d2d-9d8a-a3027c08b46c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:20.763507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fe0f0460-f9c2-4d2d-9d8a-a3027c08b46c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:20.790085 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fe0f0460-f9c2-4d2d-9d8a-a3027c08b46c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:20.801625 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fe0f0460-f9c2-4d2d-9d8a-a3027c08b46c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:20.802726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fe0f0460-f9c2-4d2d-9d8a-a3027c08b46c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:20.803353 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fe0f0460-f9c2-4d2d-9d8a-a3027c08b46c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:20.889365 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c395c3e4-8e29-468f-b350-d2de9166497e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:20.897754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c395c3e4-8e29-468f-b350-d2de9166497e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1092 microversion: 2.1 time: 0.156422 Apr 14 16:14:20.898391 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 268/532] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:20 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1092 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:21.058649 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fe0f0460-f9c2-4d2d-9d8a-a3027c08b46c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:21.068361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fe0f0460-f9c2-4d2d-9d8a-a3027c08b46c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1513 microversion: 2.1 time: 0.313411 Apr 14 16:14:21.079774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 265/533] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:20 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1513 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:21.133928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ee564d4c-2062-4ddd-8962-15e7573a03b3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:21.134592 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ee564d4c-2062-4ddd-8962-15e7573a03b3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:21.147031 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee564d4c-2062-4ddd-8962-15e7573a03b3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:21.147732 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee564d4c-2062-4ddd-8962-15e7573a03b3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:21.148674 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee564d4c-2062-4ddd-8962-15e7573a03b3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:21.149558 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee564d4c-2062-4ddd-8962-15e7573a03b3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:21.373811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ee564d4c-2062-4ddd-8962-15e7573a03b3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:21.384888 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ee564d4c-2062-4ddd-8962-15e7573a03b3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.254867 Apr 14 16:14:21.395902 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 269/534] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:21 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:21.419003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6cea5288-c221-4e74-acdf-78d1eb1370f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:21.419680 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6cea5288-c221-4e74-acdf-78d1eb1370f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:21.427642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6cea5288-c221-4e74-acdf-78d1eb1370f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:21.428157 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6cea5288-c221-4e74-acdf-78d1eb1370f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:21.429012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6cea5288-c221-4e74-acdf-78d1eb1370f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:21.429538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6cea5288-c221-4e74-acdf-78d1eb1370f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:21.680884 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-922286b2-4040-4ac6-b1aa-38b1993b923b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:21.681673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-922286b2-4040-4ac6-b1aa-38b1993b923b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:21.690592 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-922286b2-4040-4ac6-b1aa-38b1993b923b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:21.691203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-922286b2-4040-4ac6-b1aa-38b1993b923b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:21.692505 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-922286b2-4040-4ac6-b1aa-38b1993b923b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:21.693237 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-922286b2-4040-4ac6-b1aa-38b1993b923b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:21.921711 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-922286b2-4040-4ac6-b1aa-38b1993b923b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:21.931448 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-922286b2-4040-4ac6-b1aa-38b1993b923b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.255359 Apr 14 16:14:21.932109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 270/535] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:21 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:21.938035 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-30ae9358-db8d-4725-a12d-0fe14582fe88 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:21.938705 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-30ae9358-db8d-4725-a12d-0fe14582fe88 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:21.946806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-30ae9358-db8d-4725-a12d-0fe14582fe88 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:21.947397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-30ae9358-db8d-4725-a12d-0fe14582fe88 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:21.948369 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-30ae9358-db8d-4725-a12d-0fe14582fe88 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:21.949024 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-30ae9358-db8d-4725-a12d-0fe14582fe88 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:22.031518 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6cea5288-c221-4e74-acdf-78d1eb1370f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:22.041528 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6cea5288-c221-4e74-acdf-78d1eb1370f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:22.043354 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6cea5288-c221-4e74-acdf-78d1eb1370f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:22.044603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6cea5288-c221-4e74-acdf-78d1eb1370f1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1740 microversion: 2.20 time: 0.630202 Apr 14 16:14:22.045537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 266/536] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:21 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1740 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:22.086748 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-acd32d89-f14c-41f5-b875-f1c22fb91484 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:22.087426 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-acd32d89-f14c-41f5-b875-f1c22fb91484 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:22.094097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-30ae9358-db8d-4725-a12d-0fe14582fe88 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:22.105470 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-30ae9358-db8d-4725-a12d-0fe14582fe88 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1190 microversion: 2.1 time: 0.171522 Apr 14 16:14:22.109588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-acd32d89-f14c-41f5-b875-f1c22fb91484 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:22.110105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-acd32d89-f14c-41f5-b875-f1c22fb91484 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:22.110963 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-acd32d89-f14c-41f5-b875-f1c22fb91484 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:22.111522 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-acd32d89-f14c-41f5-b875-f1c22fb91484 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:22.127801 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 271/537] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:21 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1190 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:22.404179 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a6cc5109-bbef-4624-866e-61af913a368d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:22.405196 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a6cc5109-bbef-4624-866e-61af913a368d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:22.416817 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-acd32d89-f14c-41f5-b875-f1c22fb91484 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:22.422217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a6cc5109-bbef-4624-866e-61af913a368d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:22.422731 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a6cc5109-bbef-4624-866e-61af913a368d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:22.427939 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a6cc5109-bbef-4624-866e-61af913a368d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:22.428726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a6cc5109-bbef-4624-866e-61af913a368d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:22.459697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-acd32d89-f14c-41f5-b875-f1c22fb91484 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1513 microversion: 2.1 time: 0.376942 Apr 14 16:14:22.461105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 267/538] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:22 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1513 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:22.937399 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-c4f2747e-1a55-45af-bdc9-5977ab0e956e req-944c5ad5-83cd-4451-b514-af9160068602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6b11f7-562d-499f-8db6-48e991d6802c", "name": "network-vif-deleted", "tag": "74e72ff8-2061-4e4e-8b24-05f30e265a90"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:22.939955 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:14:22.939955 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:14:22.963485 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-c4f2747e-1a55-45af-bdc9-5977ab0e956e req-944c5ad5-83cd-4451-b514-af9160068602 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:22.964405 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-c4f2747e-1a55-45af-bdc9-5977ab0e956e req-944c5ad5-83cd-4451-b514-af9160068602 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:23.012061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-c4f2747e-1a55-45af-bdc9-5977ab0e956e req-944c5ad5-83cd-4451-b514-af9160068602 service nova] Creating event network-vif-deleted:74e72ff8-2061-4e4e-8b24-05f30e265a90 for instance fb6b11f7-562d-499f-8db6-48e991d6802c on hv-cinder-78626 Apr 14 16:14:23.024334 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-c4f2747e-1a55-45af-bdc9-5977ab0e956e req-944c5ad5-83cd-4451-b514-af9160068602 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091238 Apr 14 16:14:23.025115 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 268/539] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:14:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:14:23.032050 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-195ff404-7cb5-4017-b190-e0e52ee1e2e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:23.033155 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-195ff404-7cb5-4017-b190-e0e52ee1e2e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:23.034155 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a6cc5109-bbef-4624-866e-61af913a368d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:23.044760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-195ff404-7cb5-4017-b190-e0e52ee1e2e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:23.045350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-195ff404-7cb5-4017-b190-e0e52ee1e2e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:23.046342 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-195ff404-7cb5-4017-b190-e0e52ee1e2e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:23.046698 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-195ff404-7cb5-4017-b190-e0e52ee1e2e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:23.064038 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a6cc5109-bbef-4624-866e-61af913a368d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1721 microversion: 2.1 time: 0.664482 Apr 14 16:14:23.065295 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 272/540] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:22 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1721 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:23.076749 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f38f9b2a-2d64-4c64-b1fd-f112ca6d4447 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:23.078147 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f38f9b2a-2d64-4c64-b1fd-f112ca6d4447 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:23.094501 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f38f9b2a-2d64-4c64-b1fd-f112ca6d4447 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:23.100194 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f38f9b2a-2d64-4c64-b1fd-f112ca6d4447 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:23.101304 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f38f9b2a-2d64-4c64-b1fd-f112ca6d4447 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:23.101950 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f38f9b2a-2d64-4c64-b1fd-f112ca6d4447 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:23.469860 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-195ff404-7cb5-4017-b190-e0e52ee1e2e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:23.480175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-195ff404-7cb5-4017-b190-e0e52ee1e2e4 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.453520 Apr 14 16:14:23.484734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 269/541] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:23 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:23.486736 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-899a05b9-f004-4f94-bcf5-85e9dd8ed1e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:23.488002 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-899a05b9-f004-4f94-bcf5-85e9dd8ed1e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:23.497360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-899a05b9-f004-4f94-bcf5-85e9dd8ed1e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:23.498025 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-899a05b9-f004-4f94-bcf5-85e9dd8ed1e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:23.498959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-899a05b9-f004-4f94-bcf5-85e9dd8ed1e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:23.499962 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-899a05b9-f004-4f94-bcf5-85e9dd8ed1e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:23.538389 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f38f9b2a-2d64-4c64-b1fd-f112ca6d4447 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:23.548681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f38f9b2a-2d64-4c64-b1fd-f112ca6d4447 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:23.550782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f38f9b2a-2d64-4c64-b1fd-f112ca6d4447 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:23.551937 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f38f9b2a-2d64-4c64-b1fd-f112ca6d4447 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1722 microversion: 2.20 time: 0.485277 Apr 14 16:14:23.565163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 273/542] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:23 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1722 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:23.570134 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4dc7fc64-55ab-4f03-aa15-38d2663d9c1c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:23.570887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4dc7fc64-55ab-4f03-aa15-38d2663d9c1c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:23.578975 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4dc7fc64-55ab-4f03-aa15-38d2663d9c1c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:23.579567 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4dc7fc64-55ab-4f03-aa15-38d2663d9c1c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:23.580488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4dc7fc64-55ab-4f03-aa15-38d2663d9c1c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:23.580982 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4dc7fc64-55ab-4f03-aa15-38d2663d9c1c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:23.655814 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4dc7fc64-55ab-4f03-aa15-38d2663d9c1c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:23.656327 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4dc7fc64-55ab-4f03-aa15-38d2663d9c1c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:23.656848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-4dc7fc64-55ab-4f03-aa15-38d2663d9c1c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lazy-loading 'fault' on Instance uuid fb6b11f7-562d-499f-8db6-48e991d6802c {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:14:23.689583 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-899a05b9-f004-4f94-bcf5-85e9dd8ed1e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:23.700065 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-899a05b9-f004-4f94-bcf5-85e9dd8ed1e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1208 microversion: 2.1 time: 0.217542 Apr 14 16:14:23.700926 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 270/543] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:23 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1208 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:23.764244 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4dc7fc64-55ab-4f03-aa15-38d2663d9c1c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:23.774963 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4dc7fc64-55ab-4f03-aa15-38d2663d9c1c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 200 len: 1307 microversion: 2.1 time: 0.208710 Apr 14 16:14:23.775715 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 274/544] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:23 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 1307 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:24.086646 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9c07bac8-6cb8-4b96-83f5-8f08923c6b58 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:24.087389 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9c07bac8-6cb8-4b96-83f5-8f08923c6b58 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:24.107361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c07bac8-6cb8-4b96-83f5-8f08923c6b58 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:24.107878 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c07bac8-6cb8-4b96-83f5-8f08923c6b58 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:24.108765 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c07bac8-6cb8-4b96-83f5-8f08923c6b58 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:24.109294 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c07bac8-6cb8-4b96-83f5-8f08923c6b58 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:24.482922 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9c07bac8-6cb8-4b96-83f5-8f08923c6b58 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:24.493485 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9c07bac8-6cb8-4b96-83f5-8f08923c6b58 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1698 microversion: 2.1 time: 0.412352 Apr 14 16:14:24.494112 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 271/545] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:24 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1698 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:24.498271 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b0af2825-93eb-4cb6-8d72-d7b294e8354f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:24.499091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b0af2825-93eb-4cb6-8d72-d7b294e8354f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:24.507216 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b0af2825-93eb-4cb6-8d72-d7b294e8354f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:24.507944 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b0af2825-93eb-4cb6-8d72-d7b294e8354f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:24.508769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b0af2825-93eb-4cb6-8d72-d7b294e8354f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:24.509462 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b0af2825-93eb-4cb6-8d72-d7b294e8354f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:24.513152 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7c304bd2-437d-4709-9e0e-ed6497684772 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:24.521437 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7c304bd2-437d-4709-9e0e-ed6497684772 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:24.521940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7c304bd2-437d-4709-9e0e-ed6497684772 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:24.592998 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7c304bd2-437d-4709-9e0e-ed6497684772 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Going to try to start instance {{(pid=99335) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 14 16:14:24.687106 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7c304bd2-437d-4709-9e0e-ed6497684772 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 202 len: 0 microversion: 2.1 time: 0.178143 Apr 14 16:14:24.692919 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 272/546] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:14:24 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:14:24.701894 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-07d1c1ec-cd59-4d1c-be70-b8c81ec810a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:24.708265 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-07d1c1ec-cd59-4d1c-be70-b8c81ec810a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:24.720157 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-07d1c1ec-cd59-4d1c-be70-b8c81ec810a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:24.720864 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-07d1c1ec-cd59-4d1c-be70-b8c81ec810a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:24.721875 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-07d1c1ec-cd59-4d1c-be70-b8c81ec810a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:24.722503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-07d1c1ec-cd59-4d1c-be70-b8c81ec810a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:24.777495 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b0af2825-93eb-4cb6-8d72-d7b294e8354f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:24.790484 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b0af2825-93eb-4cb6-8d72-d7b294e8354f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.296091 Apr 14 16:14:24.791467 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 275/547] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:24 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:24.797422 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-0737ee30-c8b1-4ab6-a883-c8f7a430f6ad req-feff94cb-d008-4343-9b87-fd8cce71bfe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e83f61-2715-436f-8d7c-88c4483cc0e5", "name": "network-vif-unplugged", "status": "completed", "tag": "d74de9c1-8188-4d05-92fc-6cdce0aa2e31"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:24.799554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:14:24.799554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:14:24.809550 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-0737ee30-c8b1-4ab6-a883-c8f7a430f6ad req-feff94cb-d008-4343-9b87-fd8cce71bfe1 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:24.810045 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-0737ee30-c8b1-4ab6-a883-c8f7a430f6ad req-feff94cb-d008-4343-9b87-fd8cce71bfe1 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:24.830061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-0737ee30-c8b1-4ab6-a883-c8f7a430f6ad req-feff94cb-d008-4343-9b87-fd8cce71bfe1 service nova] Creating event network-vif-unplugged:d74de9c1-8188-4d05-92fc-6cdce0aa2e31 for instance 97e83f61-2715-436f-8d7c-88c4483cc0e5 on hv-cinder-78626 Apr 14 16:14:24.835309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-0737ee30-c8b1-4ab6-a883-c8f7a430f6ad req-feff94cb-d008-4343-9b87-fd8cce71bfe1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042015 Apr 14 16:14:24.836182 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 276/548] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:14:24 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:14:24.843566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8366c03b-15f8-47f4-ae1e-f30bd2a5cf6a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:24.844458 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8366c03b-15f8-47f4-ae1e-f30bd2a5cf6a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:24.853588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8366c03b-15f8-47f4-ae1e-f30bd2a5cf6a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:24.854259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8366c03b-15f8-47f4-ae1e-f30bd2a5cf6a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:24.855599 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8366c03b-15f8-47f4-ae1e-f30bd2a5cf6a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:24.856283 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8366c03b-15f8-47f4-ae1e-f30bd2a5cf6a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:25.035541 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-07d1c1ec-cd59-4d1c-be70-b8c81ec810a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:25.047380 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-07d1c1ec-cd59-4d1c-be70-b8c81ec810a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:25.049214 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-07d1c1ec-cd59-4d1c-be70-b8c81ec810a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:25.050901 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-07d1c1ec-cd59-4d1c-be70-b8c81ec810a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1722 microversion: 2.20 time: 0.355803 Apr 14 16:14:25.051512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 273/549] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:24 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1722 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:25.056020 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1a1d0d8f-54e3-4881-bdf8-3eb2dcfd6967 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:25.057140 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1a1d0d8f-54e3-4881-bdf8-3eb2dcfd6967 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:25.065950 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1a1d0d8f-54e3-4881-bdf8-3eb2dcfd6967 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:25.066841 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1a1d0d8f-54e3-4881-bdf8-3eb2dcfd6967 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:25.067922 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1a1d0d8f-54e3-4881-bdf8-3eb2dcfd6967 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:25.068560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1a1d0d8f-54e3-4881-bdf8-3eb2dcfd6967 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:25.213008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8366c03b-15f8-47f4-ae1e-f30bd2a5cf6a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:25.223571 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8366c03b-15f8-47f4-ae1e-f30bd2a5cf6a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1707 microversion: 2.1 time: 0.384815 Apr 14 16:14:25.231463 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 277/550] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:24 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1707 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:25.231463 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d4d091cb-0dff-4261-a029-405ffec97899 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:25.231463 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d4d091cb-0dff-4261-a029-405ffec97899 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: fb6b11f7-562d-499f-8db6-48e991d6802c] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:25.237948 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d4d091cb-0dff-4261-a029-405ffec97899 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:25.238467 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d4d091cb-0dff-4261-a029-405ffec97899 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:25.239461 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d4d091cb-0dff-4261-a029-405ffec97899 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:25.239806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d4d091cb-0dff-4261-a029-405ffec97899 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:25.298273 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-d4d091cb-0dff-4261-a029-405ffec97899 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] HTTP exception thrown: Instance fb6b11f7-562d-499f-8db6-48e991d6802c could not be found. Apr 14 16:14:25.298939 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d4d091cb-0dff-4261-a029-405ffec97899 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Returning 404 to user: Instance fb6b11f7-562d-499f-8db6-48e991d6802c could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:14:25.299852 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d4d091cb-0dff-4261-a029-405ffec97899 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c" status: 404 len: 111 microversion: 2.1 time: 0.074488 Apr 14 16:14:25.300697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 278/551] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:25 2021] GET /compute/v2.1/servers/fb6b11f7-562d-499f-8db6-48e991d6802c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:14:25.308975 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6fa2ea6e-b194-419c-b9cd-222e549b527c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:25.309559 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6fa2ea6e-b194-419c-b9cd-222e549b527c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:25.317352 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6fa2ea6e-b194-419c-b9cd-222e549b527c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:25.318319 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6fa2ea6e-b194-419c-b9cd-222e549b527c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:25.318865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6fa2ea6e-b194-419c-b9cd-222e549b527c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:25.319648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6fa2ea6e-b194-419c-b9cd-222e549b527c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:25.394147 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6fa2ea6e-b194-419c-b9cd-222e549b527c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Going to try to terminate instance {{(pid=99334) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:14:25.560389 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6fa2ea6e-b194-419c-b9cd-222e549b527c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 204 len: 0 microversion: 2.1 time: 0.252466 Apr 14 16:14:25.561616 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 279/552] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:14:25 2021] DELETE /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 14 16:14:25.572339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-43ed9ec5-5754-481d-8e0e-bce19298d52e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:25.575094 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-43ed9ec5-5754-481d-8e0e-bce19298d52e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:25.586571 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43ed9ec5-5754-481d-8e0e-bce19298d52e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:25.587844 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43ed9ec5-5754-481d-8e0e-bce19298d52e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:25.589537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43ed9ec5-5754-481d-8e0e-bce19298d52e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:25.590899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43ed9ec5-5754-481d-8e0e-bce19298d52e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:25.809885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1a1d0d8f-54e3-4881-bdf8-3eb2dcfd6967 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:25.819072 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1a1d0d8f-54e3-4881-bdf8-3eb2dcfd6967 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.766601 Apr 14 16:14:25.819923 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 274/553] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:25 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:25.825523 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d458e54c-f07b-4327-8be5-6fc40ad70fb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:25.826392 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d458e54c-f07b-4327-8be5-6fc40ad70fb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:25.834323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d458e54c-f07b-4327-8be5-6fc40ad70fb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:25.835068 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d458e54c-f07b-4327-8be5-6fc40ad70fb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:25.836078 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d458e54c-f07b-4327-8be5-6fc40ad70fb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:25.836742 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d458e54c-f07b-4327-8be5-6fc40ad70fb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:26.147147 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-43ed9ec5-5754-481d-8e0e-bce19298d52e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:26.158848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-43ed9ec5-5754-481d-8e0e-bce19298d52e tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1512 microversion: 2.1 time: 0.591500 Apr 14 16:14:26.160846 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 280/554] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:25 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1512 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:26.173895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9e3ead2e-99a2-4add-a8e8-9106a59fbfc0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:26.174694 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9e3ead2e-99a2-4add-a8e8-9106a59fbfc0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:26.183867 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9e3ead2e-99a2-4add-a8e8-9106a59fbfc0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:26.184619 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9e3ead2e-99a2-4add-a8e8-9106a59fbfc0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:26.185553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9e3ead2e-99a2-4add-a8e8-9106a59fbfc0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:26.186166 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9e3ead2e-99a2-4add-a8e8-9106a59fbfc0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:26.236786 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d458e54c-f07b-4327-8be5-6fc40ad70fb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:26.250733 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d458e54c-f07b-4327-8be5-6fc40ad70fb5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.429129 Apr 14 16:14:26.252400 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 275/555] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:25 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:26.259382 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-88ddfe34-6527-4284-bcbf-c9fb89e12b65 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:26.260207 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-88ddfe34-6527-4284-bcbf-c9fb89e12b65 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:26.270090 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-88ddfe34-6527-4284-bcbf-c9fb89e12b65 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:26.270834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-88ddfe34-6527-4284-bcbf-c9fb89e12b65 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:26.271850 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-88ddfe34-6527-4284-bcbf-c9fb89e12b65 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:26.272503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-88ddfe34-6527-4284-bcbf-c9fb89e12b65 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:26.552299 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9e3ead2e-99a2-4add-a8e8-9106a59fbfc0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:26.563114 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9e3ead2e-99a2-4add-a8e8-9106a59fbfc0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:26.564783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9e3ead2e-99a2-4add-a8e8-9106a59fbfc0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:26.566225 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9e3ead2e-99a2-4add-a8e8-9106a59fbfc0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1722 microversion: 2.20 time: 0.396528 Apr 14 16:14:26.578545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 281/556] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:26 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1722 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:26.578545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-55cbb5d2-6966-44aa-b7fe-f471bab11c59 req-6ebe4789-1e63-461b-a5ba-1a4695b8473e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bca69cc6-ca35-4146-8a19-b3e35097b152", "tag": "795f1499-91ff-4e4d-8ef8-0d1a0241293e"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:26.578545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:14:26.578545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:14:26.584663 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-55cbb5d2-6966-44aa-b7fe-f471bab11c59 req-6ebe4789-1e63-461b-a5ba-1a4695b8473e service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:26.584663 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-55cbb5d2-6966-44aa-b7fe-f471bab11c59 req-6ebe4789-1e63-461b-a5ba-1a4695b8473e service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:26.602698 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-55cbb5d2-6966-44aa-b7fe-f471bab11c59 req-6ebe4789-1e63-461b-a5ba-1a4695b8473e service nova] Creating event network-changed:795f1499-91ff-4e4d-8ef8-0d1a0241293e for instance bca69cc6-ca35-4146-8a19-b3e35097b152 on hv-cinder-78626 Apr 14 16:14:26.608720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-55cbb5d2-6966-44aa-b7fe-f471bab11c59 req-6ebe4789-1e63-461b-a5ba-1a4695b8473e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040315 Apr 14 16:14:26.609443 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 282/557] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:14:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:14:26.631896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-88ddfe34-6527-4284-bcbf-c9fb89e12b65 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:26.645989 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-88ddfe34-6527-4284-bcbf-c9fb89e12b65 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1707 microversion: 2.1 time: 0.392139 Apr 14 16:14:26.646932 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 276/558] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:26 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1707 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:26.838439 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-51201095-286f-4797-9625-0c35532d8eb6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:26.839884 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-51201095-286f-4797-9625-0c35532d8eb6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:26.848722 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-51201095-286f-4797-9625-0c35532d8eb6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:26.849266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-51201095-286f-4797-9625-0c35532d8eb6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:26.850149 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-51201095-286f-4797-9625-0c35532d8eb6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:26.850762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-51201095-286f-4797-9625-0c35532d8eb6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:27.106551 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-51201095-286f-4797-9625-0c35532d8eb6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:27.124665 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-51201095-286f-4797-9625-0c35532d8eb6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.290794 Apr 14 16:14:27.125402 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 283/559] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:26 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:27.179126 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-25001268-e89c-43d1-a5f9-529e8a6c2d84 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:27.179826 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-25001268-e89c-43d1-a5f9-529e8a6c2d84 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:27.188599 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25001268-e89c-43d1-a5f9-529e8a6c2d84 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:27.189155 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25001268-e89c-43d1-a5f9-529e8a6c2d84 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:27.190046 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25001268-e89c-43d1-a5f9-529e8a6c2d84 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:27.190544 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25001268-e89c-43d1-a5f9-529e8a6c2d84 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:27.270594 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-081ce5b6-c7a6-4036-8113-4c77d63ffb1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:27.271265 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-081ce5b6-c7a6-4036-8113-4c77d63ffb1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:27.280628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-081ce5b6-c7a6-4036-8113-4c77d63ffb1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:27.281078 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-081ce5b6-c7a6-4036-8113-4c77d63ffb1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:27.281975 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-081ce5b6-c7a6-4036-8113-4c77d63ffb1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:27.282468 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-081ce5b6-c7a6-4036-8113-4c77d63ffb1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:27.486600 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-081ce5b6-c7a6-4036-8113-4c77d63ffb1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:27.497028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-081ce5b6-c7a6-4036-8113-4c77d63ffb1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.230387 Apr 14 16:14:27.505482 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 284/560] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:27 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:27.585890 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-25001268-e89c-43d1-a5f9-529e8a6c2d84 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:27.586776 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7fdd5993-2bfa-4c25-ad07-a3e969f8e888 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:27.587644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7fdd5993-2bfa-4c25-ad07-a3e969f8e888 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:27.596170 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-25001268-e89c-43d1-a5f9-529e8a6c2d84 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1512 microversion: 2.1 time: 0.421047 Apr 14 16:14:27.596719 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7fdd5993-2bfa-4c25-ad07-a3e969f8e888 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:27.606958 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 277/561] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:27 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1512 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:27.607156 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7fdd5993-2bfa-4c25-ad07-a3e969f8e888 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:27.607156 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7fdd5993-2bfa-4c25-ad07-a3e969f8e888 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:27.607156 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7fdd5993-2bfa-4c25-ad07-a3e969f8e888 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:27.665396 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-036bd88a-a12e-48b3-b65f-b05e4a6dbcc0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:27.666074 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-036bd88a-a12e-48b3-b65f-b05e4a6dbcc0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:27.675546 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-036bd88a-a12e-48b3-b65f-b05e4a6dbcc0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:27.676059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-036bd88a-a12e-48b3-b65f-b05e4a6dbcc0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:27.676907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-036bd88a-a12e-48b3-b65f-b05e4a6dbcc0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:27.677426 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-036bd88a-a12e-48b3-b65f-b05e4a6dbcc0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:27.808471 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7fdd5993-2bfa-4c25-ad07-a3e969f8e888 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:27.824378 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7fdd5993-2bfa-4c25-ad07-a3e969f8e888 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:27.826157 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7fdd5993-2bfa-4c25-ad07-a3e969f8e888 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:27.827402 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7fdd5993-2bfa-4c25-ad07-a3e969f8e888 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1665 microversion: 2.20 time: 0.244915 Apr 14 16:14:27.828197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 285/562] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:27 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1665 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:14:27.847340 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6d93de9c-dbde-460a-9140-e22c41e69ab1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23590de3-9668-479b-8bdd-1418c4a17a08"}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:27.848537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6d93de9c-dbde-460a-9140-e22c41e69ab1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:27.857985 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6d93de9c-dbde-460a-9140-e22c41e69ab1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:27.858495 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6d93de9c-dbde-460a-9140-e22c41e69ab1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:27.859335 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6d93de9c-dbde-460a-9140-e22c41e69ab1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:27.859824 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6d93de9c-dbde-460a-9140-e22c41e69ab1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:27.992812 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-036bd88a-a12e-48b3-b65f-b05e4a6dbcc0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:28.002781 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-036bd88a-a12e-48b3-b65f-b05e4a6dbcc0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1711 microversion: 2.1 time: 0.341475 Apr 14 16:14:28.003767 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 278/563] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:27 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1711 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:28.144314 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f29897aa-e381-4179-ab27-20c4ca6e6425 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:28.144982 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f29897aa-e381-4179-ab27-20c4ca6e6425 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:28.154154 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f29897aa-e381-4179-ab27-20c4ca6e6425 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:28.154659 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f29897aa-e381-4179-ab27-20c4ca6e6425 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:28.156026 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f29897aa-e381-4179-ab27-20c4ca6e6425 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:28.156139 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f29897aa-e381-4179-ab27-20c4ca6e6425 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:28.351870 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6d93de9c-dbde-460a-9140-e22c41e69ab1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.508477 Apr 14 16:14:28.352645 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 286/564] 10.222.0.60 () {62 vars in 1354 bytes} [Wed Apr 14 16:14:27 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/os-volume_attachments => generated 188 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:14:28.443649 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f29897aa-e381-4179-ab27-20c4ca6e6425 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:28.453747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f29897aa-e381-4179-ab27-20c4ca6e6425 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.314376 Apr 14 16:14:28.454790 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 279/565] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:28 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:28.474638 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b140d6b1-8ee6-43ab-b063-4266264f5af7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:28.475259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b140d6b1-8ee6-43ab-b063-4266264f5af7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:28.483219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b140d6b1-8ee6-43ab-b063-4266264f5af7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:28.483728 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b140d6b1-8ee6-43ab-b063-4266264f5af7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:28.484577 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b140d6b1-8ee6-43ab-b063-4266264f5af7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:28.485105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b140d6b1-8ee6-43ab-b063-4266264f5af7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:28.516547 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-19887bbf-0941-49f3-8483-5e627c79b9ce tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:28.517266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-19887bbf-0941-49f3-8483-5e627c79b9ce tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:28.525121 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19887bbf-0941-49f3-8483-5e627c79b9ce tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:28.525630 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19887bbf-0941-49f3-8483-5e627c79b9ce tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:28.526488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19887bbf-0941-49f3-8483-5e627c79b9ce tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:28.526982 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19887bbf-0941-49f3-8483-5e627c79b9ce tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:28.649870 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b140d6b1-8ee6-43ab-b063-4266264f5af7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action" status: 202 len: 0 microversion: 2.20 time: 0.178969 Apr 14 16:14:28.650815 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 287/566] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:14:28 2021] POST /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:14:28.655343 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6b080a91-4a7a-4598-9487-b4512e2a1126 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:28.656004 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6b080a91-4a7a-4598-9487-b4512e2a1126 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:28.664836 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b080a91-4a7a-4598-9487-b4512e2a1126 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:28.665195 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b080a91-4a7a-4598-9487-b4512e2a1126 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:28.665947 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b080a91-4a7a-4598-9487-b4512e2a1126 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:28.666595 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b080a91-4a7a-4598-9487-b4512e2a1126 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:28.748601 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-19887bbf-0941-49f3-8483-5e627c79b9ce tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:28.758774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-19887bbf-0941-49f3-8483-5e627c79b9ce tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.246455 Apr 14 16:14:28.759420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 280/567] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:28 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:28.768232 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a12ade56-da97-4997-bbf8-d4c19efc3762 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:28.769077 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a12ade56-da97-4997-bbf8-d4c19efc3762 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:28.778844 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a12ade56-da97-4997-bbf8-d4c19efc3762 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:28.779682 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a12ade56-da97-4997-bbf8-d4c19efc3762 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:28.780647 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a12ade56-da97-4997-bbf8-d4c19efc3762 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:28.781355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a12ade56-da97-4997-bbf8-d4c19efc3762 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:28.996249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a12ade56-da97-4997-bbf8-d4c19efc3762 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:29.006968 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a12ade56-da97-4997-bbf8-d4c19efc3762 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:29.008681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a12ade56-da97-4997-bbf8-d4c19efc3762 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:29.010005 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a12ade56-da97-4997-bbf8-d4c19efc3762 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1751 microversion: 2.20 time: 0.246689 Apr 14 16:14:29.019807 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 281/568] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:28 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1751 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:29.404527 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6b080a91-4a7a-4598-9487-b4512e2a1126 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:29.414945 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6b080a91-4a7a-4598-9487-b4512e2a1126 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1512 microversion: 2.1 time: 0.763453 Apr 14 16:14:29.415787 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 288/569] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:28 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1512 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:29.472442 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ee029977-fd8b-47c3-894a-f18af3408f37 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:29.473169 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ee029977-fd8b-47c3-894a-f18af3408f37 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:29.481956 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee029977-fd8b-47c3-894a-f18af3408f37 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:29.482687 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee029977-fd8b-47c3-894a-f18af3408f37 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:29.483961 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee029977-fd8b-47c3-894a-f18af3408f37 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:29.484782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee029977-fd8b-47c3-894a-f18af3408f37 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:29.727896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ee029977-fd8b-47c3-894a-f18af3408f37 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:29.737956 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ee029977-fd8b-47c3-894a-f18af3408f37 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.270084 Apr 14 16:14:29.738595 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 282/570] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:29 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:29.777554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-11330fdc-a51f-41fc-8f1e-1c67633c33bd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:29.778197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-11330fdc-a51f-41fc-8f1e-1c67633c33bd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:29.779226 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-a8e2afe5-3a57-43d3-83f0-a3e8176819ed req-802b8118-70fc-4bb5-bc3d-916ecdc6bb14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce4fd86-3ba7-4f6b-8962-e1adecda486d", "name": "network-vif-deleted", "tag": "6e058dba-7fbb-4a6f-9393-4264eeea9e1a"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:29.781112 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:14:29.781112 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:14:29.787894 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11330fdc-a51f-41fc-8f1e-1c67633c33bd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:29.788491 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11330fdc-a51f-41fc-8f1e-1c67633c33bd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:29.789418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11330fdc-a51f-41fc-8f1e-1c67633c33bd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:29.790100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11330fdc-a51f-41fc-8f1e-1c67633c33bd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:29.790605 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-a8e2afe5-3a57-43d3-83f0-a3e8176819ed req-802b8118-70fc-4bb5-bc3d-916ecdc6bb14 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:29.791113 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-a8e2afe5-3a57-43d3-83f0-a3e8176819ed req-802b8118-70fc-4bb5-bc3d-916ecdc6bb14 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:29.815273 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-a8e2afe5-3a57-43d3-83f0-a3e8176819ed req-802b8118-70fc-4bb5-bc3d-916ecdc6bb14 service nova] Creating event network-vif-deleted:6e058dba-7fbb-4a6f-9393-4264eeea9e1a for instance bce4fd86-3ba7-4f6b-8962-e1adecda486d on hv-cinder-78626 Apr 14 16:14:29.821701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-a8e2afe5-3a57-43d3-83f0-a3e8176819ed req-802b8118-70fc-4bb5-bc3d-916ecdc6bb14 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046591 Apr 14 16:14:29.823205 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 283/571] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:14:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:14:30.007390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-11330fdc-a51f-41fc-8f1e-1c67633c33bd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:30.016922 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-11330fdc-a51f-41fc-8f1e-1c67633c33bd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.243533 Apr 14 16:14:30.017709 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 289/572] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:29 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:30.032052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ff7d6af8-6b77-4fc1-95c4-0523f3f64227 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:30.032960 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ff7d6af8-6b77-4fc1-95c4-0523f3f64227 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:30.041673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ff7d6af8-6b77-4fc1-95c4-0523f3f64227 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:30.042968 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ff7d6af8-6b77-4fc1-95c4-0523f3f64227 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:30.043896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ff7d6af8-6b77-4fc1-95c4-0523f3f64227 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:30.044465 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ff7d6af8-6b77-4fc1-95c4-0523f3f64227 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:30.243795 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ff7d6af8-6b77-4fc1-95c4-0523f3f64227 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:30.254028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ff7d6af8-6b77-4fc1-95c4-0523f3f64227 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:30.255710 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ff7d6af8-6b77-4fc1-95c4-0523f3f64227 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:30.256941 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ff7d6af8-6b77-4fc1-95c4-0523f3f64227 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1753 microversion: 2.20 time: 0.229608 Apr 14 16:14:30.257605 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 284/573] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:30 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1753 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:30.433917 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-11952be2-4cbe-4f4d-a277-3a75531f843a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:30.434621 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-11952be2-4cbe-4f4d-a277-3a75531f843a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:30.442600 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11952be2-4cbe-4f4d-a277-3a75531f843a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:30.443110 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11952be2-4cbe-4f4d-a277-3a75531f843a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:30.443952 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11952be2-4cbe-4f4d-a277-3a75531f843a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:30.444442 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11952be2-4cbe-4f4d-a277-3a75531f843a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:30.523562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11952be2-4cbe-4f4d-a277-3a75531f843a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:30.524073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11952be2-4cbe-4f4d-a277-3a75531f843a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:30.524584 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-11952be2-4cbe-4f4d-a277-3a75531f843a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lazy-loading 'fault' on Instance uuid bce4fd86-3ba7-4f6b-8962-e1adecda486d {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:14:30.609257 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-11952be2-4cbe-4f4d-a277-3a75531f843a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:30.617920 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-11952be2-4cbe-4f4d-a277-3a75531f843a tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 200 len: 1307 microversion: 2.1 time: 0.188262 Apr 14 16:14:30.618559 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 290/574] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:30 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 1307 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:30.756205 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-80784ad5-6496-463b-8415-22e8c4d6cdcc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:30.756876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-80784ad5-6496-463b-8415-22e8c4d6cdcc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:30.765355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-80784ad5-6496-463b-8415-22e8c4d6cdcc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:30.765860 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-80784ad5-6496-463b-8415-22e8c4d6cdcc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:30.766694 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-80784ad5-6496-463b-8415-22e8c4d6cdcc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:30.767181 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-80784ad5-6496-463b-8415-22e8c4d6cdcc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:30.964865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-80784ad5-6496-463b-8415-22e8c4d6cdcc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:30.974164 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-80784ad5-6496-463b-8415-22e8c4d6cdcc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.221870 Apr 14 16:14:30.974790 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 285/575] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:30 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:31.035979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bc3c383b-c135-4506-baa9-28c9385f19f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:31.036817 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bc3c383b-c135-4506-baa9-28c9385f19f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:31.045224 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bc3c383b-c135-4506-baa9-28c9385f19f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:31.045735 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bc3c383b-c135-4506-baa9-28c9385f19f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:31.046580 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bc3c383b-c135-4506-baa9-28c9385f19f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:31.047079 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bc3c383b-c135-4506-baa9-28c9385f19f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:31.278114 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ccf285fb-818b-4d04-a3d6-e1d3866f5210 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:31.278799 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ccf285fb-818b-4d04-a3d6-e1d3866f5210 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:31.287129 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccf285fb-818b-4d04-a3d6-e1d3866f5210 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:31.287642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccf285fb-818b-4d04-a3d6-e1d3866f5210 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:31.288488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccf285fb-818b-4d04-a3d6-e1d3866f5210 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:31.288982 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccf285fb-818b-4d04-a3d6-e1d3866f5210 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:31.323133 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bc3c383b-c135-4506-baa9-28c9385f19f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:31.333178 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bc3c383b-c135-4506-baa9-28c9385f19f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.301513 Apr 14 16:14:31.333903 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 291/576] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:31 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:31.490515 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ccf285fb-818b-4d04-a3d6-e1d3866f5210 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:31.500624 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ccf285fb-818b-4d04-a3d6-e1d3866f5210 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:31.502366 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ccf285fb-818b-4d04-a3d6-e1d3866f5210 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:31.503596 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ccf285fb-818b-4d04-a3d6-e1d3866f5210 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1753 microversion: 2.20 time: 0.230013 Apr 14 16:14:31.504224 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 286/577] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:31 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1753 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:14:31.636014 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f62747ce-1b11-4b99-bf54-48420f621aeb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:31.636672 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f62747ce-1b11-4b99-bf54-48420f621aeb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: bce4fd86-3ba7-4f6b-8962-e1adecda486d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:31.644538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f62747ce-1b11-4b99-bf54-48420f621aeb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:31.645046 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f62747ce-1b11-4b99-bf54-48420f621aeb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:31.645882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f62747ce-1b11-4b99-bf54-48420f621aeb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:31.646373 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f62747ce-1b11-4b99-bf54-48420f621aeb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:31.701688 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-f62747ce-1b11-4b99-bf54-48420f621aeb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] HTTP exception thrown: Instance bce4fd86-3ba7-4f6b-8962-e1adecda486d could not be found. Apr 14 16:14:31.702353 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f62747ce-1b11-4b99-bf54-48420f621aeb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Returning 404 to user: Instance bce4fd86-3ba7-4f6b-8962-e1adecda486d could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:14:31.703257 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f62747ce-1b11-4b99-bf54-48420f621aeb tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d" status: 404 len: 111 microversion: 2.1 time: 0.071388 Apr 14 16:14:31.703887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 292/578] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:31 2021] GET /compute/v2.1/servers/bce4fd86-3ba7-4f6b-8962-e1adecda486d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:14:31.992119 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d891071a-6306-4dd3-b98d-36ad16f4aafe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:31.993054 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d891071a-6306-4dd3-b98d-36ad16f4aafe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:32.001685 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d891071a-6306-4dd3-b98d-36ad16f4aafe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:32.002199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d891071a-6306-4dd3-b98d-36ad16f4aafe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:32.003087 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d891071a-6306-4dd3-b98d-36ad16f4aafe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:32.003629 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d891071a-6306-4dd3-b98d-36ad16f4aafe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:32.206908 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d891071a-6306-4dd3-b98d-36ad16f4aafe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:32.217441 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d891071a-6306-4dd3-b98d-36ad16f4aafe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.229367 Apr 14 16:14:32.218128 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 287/579] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:31 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:32.351638 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-32914509-2716-4d66-882c-776cd3850052 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:32.352306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-32914509-2716-4d66-882c-776cd3850052 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:32.360422 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-32914509-2716-4d66-882c-776cd3850052 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:32.360927 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-32914509-2716-4d66-882c-776cd3850052 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:32.361784 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-32914509-2716-4d66-882c-776cd3850052 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:32.362271 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-32914509-2716-4d66-882c-776cd3850052 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:32.523553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-28da2db1-5dee-41a2-b6f9-885d90b23516 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:32.524220 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-28da2db1-5dee-41a2-b6f9-885d90b23516 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:32.532606 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-28da2db1-5dee-41a2-b6f9-885d90b23516 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:32.533164 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-28da2db1-5dee-41a2-b6f9-885d90b23516 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:32.534282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-28da2db1-5dee-41a2-b6f9-885d90b23516 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:32.534785 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-28da2db1-5dee-41a2-b6f9-885d90b23516 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:32.557521 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-32914509-2716-4d66-882c-776cd3850052 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:32.567434 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-32914509-2716-4d66-882c-776cd3850052 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.219972 Apr 14 16:14:32.568056 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 293/580] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:32 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:32.935730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-28da2db1-5dee-41a2-b6f9-885d90b23516 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:32.946023 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-28da2db1-5dee-41a2-b6f9-885d90b23516 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:32.947826 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-28da2db1-5dee-41a2-b6f9-885d90b23516 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:32.949355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-28da2db1-5dee-41a2-b6f9-885d90b23516 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.429960 Apr 14 16:14:32.949982 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 288/581] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:32 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:32.961690 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-be40cb43-93c8-4840-8350-3e88ee066357 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:32.962232 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-be40cb43-93c8-4840-8350-3e88ee066357 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:32.970802 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-be40cb43-93c8-4840-8350-3e88ee066357 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:32.971304 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-be40cb43-93c8-4840-8350-3e88ee066357 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:32.972128 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-be40cb43-93c8-4840-8350-3e88ee066357 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:32.972607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-be40cb43-93c8-4840-8350-3e88ee066357 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:33.038775 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-be40cb43-93c8-4840-8350-3e88ee066357 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Going to try to terminate instance {{(pid=99334) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:14:33.165927 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-be40cb43-93c8-4840-8350-3e88ee066357 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 204 len: 0 microversion: 2.1 time: 0.207932 Apr 14 16:14:33.166574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 294/582] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:14:32 2021] DELETE /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 14 16:14:33.176058 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d0ca8f4a-2580-492e-b695-4fe66236771c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:33.176983 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d0ca8f4a-2580-492e-b695-4fe66236771c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:33.185237 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d0ca8f4a-2580-492e-b695-4fe66236771c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:33.185730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d0ca8f4a-2580-492e-b695-4fe66236771c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:33.186768 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d0ca8f4a-2580-492e-b695-4fe66236771c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:33.187257 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d0ca8f4a-2580-492e-b695-4fe66236771c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:33.296832 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c8e1cc6f-9edf-4075-81cb-4a41afb17dd4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:33.302909 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c8e1cc6f-9edf-4075-81cb-4a41afb17dd4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:33.311891 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c8e1cc6f-9edf-4075-81cb-4a41afb17dd4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:33.312411 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c8e1cc6f-9edf-4075-81cb-4a41afb17dd4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:33.313331 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c8e1cc6f-9edf-4075-81cb-4a41afb17dd4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:33.313827 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c8e1cc6f-9edf-4075-81cb-4a41afb17dd4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:33.558934 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d0ca8f4a-2580-492e-b695-4fe66236771c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:33.569812 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d0ca8f4a-2580-492e-b695-4fe66236771c tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.398065 Apr 14 16:14:33.570786 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 289/583] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:33 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:33.602656 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1355062b-2246-424c-bc73-9ee422e59ae9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:33.603738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1355062b-2246-424c-bc73-9ee422e59ae9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:33.614572 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1355062b-2246-424c-bc73-9ee422e59ae9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:33.615084 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1355062b-2246-424c-bc73-9ee422e59ae9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:33.615942 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1355062b-2246-424c-bc73-9ee422e59ae9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:33.616433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1355062b-2246-424c-bc73-9ee422e59ae9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:33.629900 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c8e1cc6f-9edf-4075-81cb-4a41afb17dd4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:33.639244 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c8e1cc6f-9edf-4075-81cb-4a41afb17dd4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.347290 Apr 14 16:14:33.640020 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 295/584] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:33 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:33.828290 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1355062b-2246-424c-bc73-9ee422e59ae9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:33.837703 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1355062b-2246-424c-bc73-9ee422e59ae9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.255583 Apr 14 16:14:33.838340 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 290/585] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:33 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:33.970095 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-43f1a02e-e7aa-41c8-a663-bce1e707cea4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:33.970738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-43f1a02e-e7aa-41c8-a663-bce1e707cea4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:33.978969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43f1a02e-e7aa-41c8-a663-bce1e707cea4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:33.980124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43f1a02e-e7aa-41c8-a663-bce1e707cea4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:33.981151 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43f1a02e-e7aa-41c8-a663-bce1e707cea4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:33.981653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43f1a02e-e7aa-41c8-a663-bce1e707cea4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:34.204564 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-43f1a02e-e7aa-41c8-a663-bce1e707cea4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:34.216296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-43f1a02e-e7aa-41c8-a663-bce1e707cea4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:34.218044 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-43f1a02e-e7aa-41c8-a663-bce1e707cea4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:34.219296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-43f1a02e-e7aa-41c8-a663-bce1e707cea4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.253396 Apr 14 16:14:34.220137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 296/586] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:33 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:34.591363 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-93739b7d-8a51-41e8-8da1-388ee74500b0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:34.592038 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-93739b7d-8a51-41e8-8da1-388ee74500b0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:34.600034 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-93739b7d-8a51-41e8-8da1-388ee74500b0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:34.600548 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-93739b7d-8a51-41e8-8da1-388ee74500b0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:34.601415 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-93739b7d-8a51-41e8-8da1-388ee74500b0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:34.601912 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-93739b7d-8a51-41e8-8da1-388ee74500b0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:34.658050 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a5e14ebb-5d06-45f0-8fcd-52765aa4f85c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:34.658759 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a5e14ebb-5d06-45f0-8fcd-52765aa4f85c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:34.666719 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5e14ebb-5d06-45f0-8fcd-52765aa4f85c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:34.667326 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5e14ebb-5d06-45f0-8fcd-52765aa4f85c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:34.668190 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5e14ebb-5d06-45f0-8fcd-52765aa4f85c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:34.668692 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5e14ebb-5d06-45f0-8fcd-52765aa4f85c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:34.810856 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-93739b7d-8a51-41e8-8da1-388ee74500b0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:34.819607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-93739b7d-8a51-41e8-8da1-388ee74500b0 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.233048 Apr 14 16:14:34.820373 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 291/587] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:34 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:34.856545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6c722e97-04c6-4586-a165-e5468c3659f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:34.857265 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6c722e97-04c6-4586-a165-e5468c3659f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:34.865289 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6c722e97-04c6-4586-a165-e5468c3659f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:34.865807 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6c722e97-04c6-4586-a165-e5468c3659f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:34.866643 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6c722e97-04c6-4586-a165-e5468c3659f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:34.867133 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6c722e97-04c6-4586-a165-e5468c3659f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:34.890798 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a5e14ebb-5d06-45f0-8fcd-52765aa4f85c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:34.916463 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a5e14ebb-5d06-45f0-8fcd-52765aa4f85c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.259714 Apr 14 16:14:34.918477 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 297/588] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:34 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:35.088891 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6c722e97-04c6-4586-a165-e5468c3659f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:35.098699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6c722e97-04c6-4586-a165-e5468c3659f8 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.246744 Apr 14 16:14:35.099335 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 292/589] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:34 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:35.239297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a467f823-6d16-4568-bd49-cdde97c18d82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:35.239954 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a467f823-6d16-4568-bd49-cdde97c18d82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:35.248266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a467f823-6d16-4568-bd49-cdde97c18d82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:35.248766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a467f823-6d16-4568-bd49-cdde97c18d82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:35.249623 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a467f823-6d16-4568-bd49-cdde97c18d82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:35.250112 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a467f823-6d16-4568-bd49-cdde97c18d82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:35.453687 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a467f823-6d16-4568-bd49-cdde97c18d82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:35.464123 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a467f823-6d16-4568-bd49-cdde97c18d82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:35.465827 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a467f823-6d16-4568-bd49-cdde97c18d82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:35.467050 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a467f823-6d16-4568-bd49-cdde97c18d82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.231868 Apr 14 16:14:35.467673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 298/590] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:35 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:35.838434 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8abeeada-b208-4a96-aba3-895c04735acd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:35.839664 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8abeeada-b208-4a96-aba3-895c04735acd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:35.847559 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8abeeada-b208-4a96-aba3-895c04735acd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:35.848058 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8abeeada-b208-4a96-aba3-895c04735acd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:35.848888 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8abeeada-b208-4a96-aba3-895c04735acd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:35.849389 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8abeeada-b208-4a96-aba3-895c04735acd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:35.936132 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b1a24492-7127-4e7a-8d12-652a3dd90835 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:35.936802 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b1a24492-7127-4e7a-8d12-652a3dd90835 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:35.950028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b1a24492-7127-4e7a-8d12-652a3dd90835 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:35.950592 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b1a24492-7127-4e7a-8d12-652a3dd90835 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:35.951677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b1a24492-7127-4e7a-8d12-652a3dd90835 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:35.952163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b1a24492-7127-4e7a-8d12-652a3dd90835 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:36.054852 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8abeeada-b208-4a96-aba3-895c04735acd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:36.065511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8abeeada-b208-4a96-aba3-895c04735acd tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.231065 Apr 14 16:14:36.066165 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 293/591] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:35 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:36.118101 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-863eaa86-b8e7-4031-aa09-423cf1f00e0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:36.119032 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-863eaa86-b8e7-4031-aa09-423cf1f00e0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:36.132452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-863eaa86-b8e7-4031-aa09-423cf1f00e0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:36.132957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-863eaa86-b8e7-4031-aa09-423cf1f00e0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:36.133924 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-863eaa86-b8e7-4031-aa09-423cf1f00e0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:36.134416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-863eaa86-b8e7-4031-aa09-423cf1f00e0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:36.176880 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b1a24492-7127-4e7a-8d12-652a3dd90835 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:36.185909 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b1a24492-7127-4e7a-8d12-652a3dd90835 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.254575 Apr 14 16:14:36.186565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 299/592] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:35 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:36.350343 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-863eaa86-b8e7-4031-aa09-423cf1f00e0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:36.360346 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-863eaa86-b8e7-4031-aa09-423cf1f00e0c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.246779 Apr 14 16:14:36.360966 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 294/593] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:36 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:36.487059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c0ac8d10-6f0a-4060-97e9-952c1eec2d18 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:36.487735 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c0ac8d10-6f0a-4060-97e9-952c1eec2d18 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:36.496840 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0ac8d10-6f0a-4060-97e9-952c1eec2d18 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:36.497375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0ac8d10-6f0a-4060-97e9-952c1eec2d18 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:36.498228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0ac8d10-6f0a-4060-97e9-952c1eec2d18 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:36.498719 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c0ac8d10-6f0a-4060-97e9-952c1eec2d18 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:36.699669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c0ac8d10-6f0a-4060-97e9-952c1eec2d18 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:36.713476 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c0ac8d10-6f0a-4060-97e9-952c1eec2d18 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:36.715882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c0ac8d10-6f0a-4060-97e9-952c1eec2d18 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:36.717152 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c0ac8d10-6f0a-4060-97e9-952c1eec2d18 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.234329 Apr 14 16:14:36.717777 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 300/594] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:36 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:37.083521 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ea7fee37-fa36-45d3-9fbb-8876858c8def tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:37.084233 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ea7fee37-fa36-45d3-9fbb-8876858c8def tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:37.092764 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ea7fee37-fa36-45d3-9fbb-8876858c8def tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:37.093324 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ea7fee37-fa36-45d3-9fbb-8876858c8def tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:37.094169 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ea7fee37-fa36-45d3-9fbb-8876858c8def tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:37.094669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ea7fee37-fa36-45d3-9fbb-8876858c8def tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:37.204524 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bf3658b0-5bc5-4703-9137-285822d861d7 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:37.205222 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bf3658b0-5bc5-4703-9137-285822d861d7 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:37.214400 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bf3658b0-5bc5-4703-9137-285822d861d7 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:37.214985 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bf3658b0-5bc5-4703-9137-285822d861d7 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:37.215997 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bf3658b0-5bc5-4703-9137-285822d861d7 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:37.216566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bf3658b0-5bc5-4703-9137-285822d861d7 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:37.301737 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ea7fee37-fa36-45d3-9fbb-8876858c8def tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:37.310869 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ea7fee37-fa36-45d3-9fbb-8876858c8def tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.231354 Apr 14 16:14:37.311508 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 295/595] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:37 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:37.389898 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-44f139bd-b4be-4baa-bbb0-91ad3946e6cf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:37.390498 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-44f139bd-b4be-4baa-bbb0-91ad3946e6cf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:37.398765 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44f139bd-b4be-4baa-bbb0-91ad3946e6cf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:37.399369 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44f139bd-b4be-4baa-bbb0-91ad3946e6cf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:37.400303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44f139bd-b4be-4baa-bbb0-91ad3946e6cf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:37.400885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44f139bd-b4be-4baa-bbb0-91ad3946e6cf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:37.441011 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bf3658b0-5bc5-4703-9137-285822d861d7 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:37.450848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bf3658b0-5bc5-4703-9137-285822d861d7 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.250418 Apr 14 16:14:37.451475 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 301/596] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:37 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:37.608537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-44f139bd-b4be-4baa-bbb0-91ad3946e6cf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:37.619204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-44f139bd-b4be-4baa-bbb0-91ad3946e6cf tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.243082 Apr 14 16:14:37.620999 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 296/597] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:37 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:37.738954 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-44b7e5e8-df0f-4313-b01f-e66fbe2300bf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:37.739620 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-44b7e5e8-df0f-4313-b01f-e66fbe2300bf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:37.753751 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44b7e5e8-df0f-4313-b01f-e66fbe2300bf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:37.754242 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44b7e5e8-df0f-4313-b01f-e66fbe2300bf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:37.755096 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44b7e5e8-df0f-4313-b01f-e66fbe2300bf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:37.755590 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44b7e5e8-df0f-4313-b01f-e66fbe2300bf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:37.960481 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-44b7e5e8-df0f-4313-b01f-e66fbe2300bf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:37.971911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-44b7e5e8-df0f-4313-b01f-e66fbe2300bf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:37.973806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-44b7e5e8-df0f-4313-b01f-e66fbe2300bf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:37.975066 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-44b7e5e8-df0f-4313-b01f-e66fbe2300bf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.240165 Apr 14 16:14:37.982818 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 302/598] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:37 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:38.329122 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b764c518-7fb2-49de-b62c-3d985ff32b65 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:38.329806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b764c518-7fb2-49de-b62c-3d985ff32b65 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:38.337929 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b764c518-7fb2-49de-b62c-3d985ff32b65 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:38.338450 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b764c518-7fb2-49de-b62c-3d985ff32b65 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:38.339822 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b764c518-7fb2-49de-b62c-3d985ff32b65 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:38.340312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b764c518-7fb2-49de-b62c-3d985ff32b65 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:38.468983 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c761049b-c1ee-41d8-8114-23c941aa48fe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:38.469795 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c761049b-c1ee-41d8-8114-23c941aa48fe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:38.477809 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c761049b-c1ee-41d8-8114-23c941aa48fe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:38.478309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c761049b-c1ee-41d8-8114-23c941aa48fe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:38.479139 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c761049b-c1ee-41d8-8114-23c941aa48fe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:38.480428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c761049b-c1ee-41d8-8114-23c941aa48fe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:38.539246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b764c518-7fb2-49de-b62c-3d985ff32b65 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:38.548248 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b764c518-7fb2-49de-b62c-3d985ff32b65 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.223276 Apr 14 16:14:38.548889 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 297/599] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:38 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:38.639370 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7003fe5e-e146-43a8-a292-5308b1a4ccb6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:38.640033 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7003fe5e-e146-43a8-a292-5308b1a4ccb6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:38.647881 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7003fe5e-e146-43a8-a292-5308b1a4ccb6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:38.648387 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7003fe5e-e146-43a8-a292-5308b1a4ccb6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:38.649236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7003fe5e-e146-43a8-a292-5308b1a4ccb6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:38.649716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7003fe5e-e146-43a8-a292-5308b1a4ccb6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:38.685330 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c761049b-c1ee-41d8-8114-23c941aa48fe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:38.694216 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c761049b-c1ee-41d8-8114-23c941aa48fe tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.229432 Apr 14 16:14:38.694859 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 303/600] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:38 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:38.853970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7003fe5e-e146-43a8-a292-5308b1a4ccb6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:38.863427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7003fe5e-e146-43a8-a292-5308b1a4ccb6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.228801 Apr 14 16:14:38.864053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 298/601] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:38 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:38.995428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b8739413-026e-4d54-bbd3-fd0d9f0dc7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:38.996057 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b8739413-026e-4d54-bbd3-fd0d9f0dc7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:39.003968 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8739413-026e-4d54-bbd3-fd0d9f0dc7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:39.004468 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8739413-026e-4d54-bbd3-fd0d9f0dc7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:39.005316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8739413-026e-4d54-bbd3-fd0d9f0dc7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:39.005801 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8739413-026e-4d54-bbd3-fd0d9f0dc7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:39.228669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b8739413-026e-4d54-bbd3-fd0d9f0dc7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:39.239155 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b8739413-026e-4d54-bbd3-fd0d9f0dc7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:39.241359 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b8739413-026e-4d54-bbd3-fd0d9f0dc7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:39.242699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b8739413-026e-4d54-bbd3-fd0d9f0dc7bc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.251407 Apr 14 16:14:39.243404 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 304/602] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:38 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:39.566574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-35e83afc-16c8-424b-99fe-c3b8b907629f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:39.567240 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-35e83afc-16c8-424b-99fe-c3b8b907629f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:39.575807 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-35e83afc-16c8-424b-99fe-c3b8b907629f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:39.576311 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-35e83afc-16c8-424b-99fe-c3b8b907629f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:39.577161 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-35e83afc-16c8-424b-99fe-c3b8b907629f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:39.577652 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-35e83afc-16c8-424b-99fe-c3b8b907629f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:39.712941 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a4c890cd-819d-4e84-9ef7-3ec96f789e39 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:39.713704 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a4c890cd-819d-4e84-9ef7-3ec96f789e39 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:39.721653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4c890cd-819d-4e84-9ef7-3ec96f789e39 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:39.722149 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4c890cd-819d-4e84-9ef7-3ec96f789e39 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:39.722977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4c890cd-819d-4e84-9ef7-3ec96f789e39 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:39.723465 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4c890cd-819d-4e84-9ef7-3ec96f789e39 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:39.789347 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-35e83afc-16c8-424b-99fe-c3b8b907629f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:39.799238 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-35e83afc-16c8-424b-99fe-c3b8b907629f tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.236617 Apr 14 16:14:39.799883 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 299/603] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:39 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:39.882548 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-42590607-20a7-4875-86fe-50f829b59a6d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:39.883175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-42590607-20a7-4875-86fe-50f829b59a6d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:39.892099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-42590607-20a7-4875-86fe-50f829b59a6d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:39.892586 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-42590607-20a7-4875-86fe-50f829b59a6d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:39.893492 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-42590607-20a7-4875-86fe-50f829b59a6d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:39.893991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-42590607-20a7-4875-86fe-50f829b59a6d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:39.957264 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a4c890cd-819d-4e84-9ef7-3ec96f789e39 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:39.966319 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a4c890cd-819d-4e84-9ef7-3ec96f789e39 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.257413 Apr 14 16:14:39.967163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 305/604] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:39 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:40.111487 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-42590607-20a7-4875-86fe-50f829b59a6d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:40.124851 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-42590607-20a7-4875-86fe-50f829b59a6d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.246327 Apr 14 16:14:40.125881 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 300/605] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:39 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:40.263246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3506cdf5-a6b8-48a2-b897-503deff05157 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:40.263955 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3506cdf5-a6b8-48a2-b897-503deff05157 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:40.272869 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3506cdf5-a6b8-48a2-b897-503deff05157 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:40.273404 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3506cdf5-a6b8-48a2-b897-503deff05157 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:40.274261 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3506cdf5-a6b8-48a2-b897-503deff05157 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:40.274757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3506cdf5-a6b8-48a2-b897-503deff05157 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:40.478013 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3506cdf5-a6b8-48a2-b897-503deff05157 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:40.488842 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3506cdf5-a6b8-48a2-b897-503deff05157 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:40.490579 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3506cdf5-a6b8-48a2-b897-503deff05157 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:40.491796 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3506cdf5-a6b8-48a2-b897-503deff05157 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.232805 Apr 14 16:14:40.492449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 306/606] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:40 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:40.818339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-aec732ea-e5ad-48f2-bb45-68abc547da23 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:40.819053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-aec732ea-e5ad-48f2-bb45-68abc547da23 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:40.827591 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aec732ea-e5ad-48f2-bb45-68abc547da23 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:40.828106 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aec732ea-e5ad-48f2-bb45-68abc547da23 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:40.828950 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aec732ea-e5ad-48f2-bb45-68abc547da23 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:40.829477 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aec732ea-e5ad-48f2-bb45-68abc547da23 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:40.984147 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c3e44043-6eed-4695-a9cb-a1223cc940af tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:40.984809 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c3e44043-6eed-4695-a9cb-a1223cc940af tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:40.992679 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c3e44043-6eed-4695-a9cb-a1223cc940af tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:40.993285 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c3e44043-6eed-4695-a9cb-a1223cc940af tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:40.994256 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c3e44043-6eed-4695-a9cb-a1223cc940af tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:40.994798 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c3e44043-6eed-4695-a9cb-a1223cc940af tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:41.042581 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-aec732ea-e5ad-48f2-bb45-68abc547da23 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:41.052266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-aec732ea-e5ad-48f2-bb45-68abc547da23 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.237753 Apr 14 16:14:41.053068 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 301/607] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:40 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:41.144103 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2e892789-88c2-4c70-a965-d444f12c798d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:41.144780 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2e892789-88c2-4c70-a965-d444f12c798d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:41.152717 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2e892789-88c2-4c70-a965-d444f12c798d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:41.153344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2e892789-88c2-4c70-a965-d444f12c798d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:41.154189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2e892789-88c2-4c70-a965-d444f12c798d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:41.154682 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2e892789-88c2-4c70-a965-d444f12c798d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:41.213137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c3e44043-6eed-4695-a9cb-a1223cc940af tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:41.222254 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c3e44043-6eed-4695-a9cb-a1223cc940af tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.242222 Apr 14 16:14:41.222859 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 307/608] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:40 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:41.369071 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2e892789-88c2-4c70-a965-d444f12c798d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:41.378547 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2e892789-88c2-4c70-a965-d444f12c798d tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.239342 Apr 14 16:14:41.379167 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 302/609] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:41 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:41.512455 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4a6fb6cd-a2dc-4146-b0cf-1d97e2c0852c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:41.513136 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4a6fb6cd-a2dc-4146-b0cf-1d97e2c0852c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:41.520897 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4a6fb6cd-a2dc-4146-b0cf-1d97e2c0852c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:41.521420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4a6fb6cd-a2dc-4146-b0cf-1d97e2c0852c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:41.522241 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4a6fb6cd-a2dc-4146-b0cf-1d97e2c0852c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:41.522723 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4a6fb6cd-a2dc-4146-b0cf-1d97e2c0852c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:41.728094 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4a6fb6cd-a2dc-4146-b0cf-1d97e2c0852c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:41.738571 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4a6fb6cd-a2dc-4146-b0cf-1d97e2c0852c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:41.740258 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4a6fb6cd-a2dc-4146-b0cf-1d97e2c0852c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:41.741534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4a6fb6cd-a2dc-4146-b0cf-1d97e2c0852c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.233829 Apr 14 16:14:41.742158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 308/610] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:41 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:42.072866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e2e63c92-7464-47fb-9d37-f3866733bc0d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:42.074588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e2e63c92-7464-47fb-9d37-f3866733bc0d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:42.084109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e2e63c92-7464-47fb-9d37-f3866733bc0d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:42.084726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e2e63c92-7464-47fb-9d37-f3866733bc0d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:42.085707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e2e63c92-7464-47fb-9d37-f3866733bc0d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:42.086940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e2e63c92-7464-47fb-9d37-f3866733bc0d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:42.240294 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ed96767e-3f6d-45de-ac3d-64f1aa5bb22f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:42.240966 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ed96767e-3f6d-45de-ac3d-64f1aa5bb22f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:42.249725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ed96767e-3f6d-45de-ac3d-64f1aa5bb22f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:42.250228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ed96767e-3f6d-45de-ac3d-64f1aa5bb22f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:42.251069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ed96767e-3f6d-45de-ac3d-64f1aa5bb22f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:42.251564 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ed96767e-3f6d-45de-ac3d-64f1aa5bb22f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:42.294904 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e2e63c92-7464-47fb-9d37-f3866733bc0d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:42.303753 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e2e63c92-7464-47fb-9d37-f3866733bc0d tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.236350 Apr 14 16:14:42.304386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 303/611] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:42 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:42.396173 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0f02bfa5-6069-45f9-b451-a2a779afaf8e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:42.396886 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0f02bfa5-6069-45f9-b451-a2a779afaf8e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:42.405245 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0f02bfa5-6069-45f9-b451-a2a779afaf8e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:42.405769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0f02bfa5-6069-45f9-b451-a2a779afaf8e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:42.406728 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0f02bfa5-6069-45f9-b451-a2a779afaf8e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:42.407233 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0f02bfa5-6069-45f9-b451-a2a779afaf8e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:42.478248 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ed96767e-3f6d-45de-ac3d-64f1aa5bb22f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:42.488388 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ed96767e-3f6d-45de-ac3d-64f1aa5bb22f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.252030 Apr 14 16:14:42.489350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 309/612] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:42 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:42.622589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0f02bfa5-6069-45f9-b451-a2a779afaf8e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:42.632381 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0f02bfa5-6069-45f9-b451-a2a779afaf8e tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.240252 Apr 14 16:14:42.633146 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 304/613] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:42 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:42.763215 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ee31552f-d147-4289-8517-81f803108c0f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:42.763879 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ee31552f-d147-4289-8517-81f803108c0f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:42.772087 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee31552f-d147-4289-8517-81f803108c0f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:42.772574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee31552f-d147-4289-8517-81f803108c0f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:42.773454 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee31552f-d147-4289-8517-81f803108c0f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:42.773939 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ee31552f-d147-4289-8517-81f803108c0f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:42.990977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ee31552f-d147-4289-8517-81f803108c0f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:43.001829 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ee31552f-d147-4289-8517-81f803108c0f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:43.003506 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ee31552f-d147-4289-8517-81f803108c0f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:43.004720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ee31552f-d147-4289-8517-81f803108c0f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.246632 Apr 14 16:14:43.005372 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 310/614] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:42 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:43.322978 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-11b69b16-83d3-4a9a-b8c3-e8db7a891aab tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:43.323721 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-11b69b16-83d3-4a9a-b8c3-e8db7a891aab tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:43.332197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11b69b16-83d3-4a9a-b8c3-e8db7a891aab tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:43.332712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11b69b16-83d3-4a9a-b8c3-e8db7a891aab tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:43.333624 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11b69b16-83d3-4a9a-b8c3-e8db7a891aab tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:43.334119 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11b69b16-83d3-4a9a-b8c3-e8db7a891aab tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:43.507648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9dabbdc4-3b32-4134-a6d1-d96a8641655f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:43.508317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9dabbdc4-3b32-4134-a6d1-d96a8641655f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:43.516946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9dabbdc4-3b32-4134-a6d1-d96a8641655f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:43.517487 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9dabbdc4-3b32-4134-a6d1-d96a8641655f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:43.518348 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9dabbdc4-3b32-4134-a6d1-d96a8641655f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:43.518846 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9dabbdc4-3b32-4134-a6d1-d96a8641655f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:43.540668 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-11b69b16-83d3-4a9a-b8c3-e8db7a891aab tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:43.552078 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-11b69b16-83d3-4a9a-b8c3-e8db7a891aab tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.233082 Apr 14 16:14:43.553089 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 305/615] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:43 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:43.674759 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7daead3f-8dcb-4afa-86e5-92c9ab7bc337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:43.675369 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7daead3f-8dcb-4afa-86e5-92c9ab7bc337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:43.685027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7daead3f-8dcb-4afa-86e5-92c9ab7bc337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:43.685695 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7daead3f-8dcb-4afa-86e5-92c9ab7bc337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:43.686557 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7daead3f-8dcb-4afa-86e5-92c9ab7bc337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:43.687047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7daead3f-8dcb-4afa-86e5-92c9ab7bc337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:43.732900 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9dabbdc4-3b32-4134-a6d1-d96a8641655f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:43.742491 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9dabbdc4-3b32-4134-a6d1-d96a8641655f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.238768 Apr 14 16:14:43.743152 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 311/616] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:43 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:43.892301 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7daead3f-8dcb-4afa-86e5-92c9ab7bc337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:43.903031 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7daead3f-8dcb-4afa-86e5-92c9ab7bc337 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.256110 Apr 14 16:14:43.904011 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 306/617] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:43 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:44.024605 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3515cc60-9a12-4164-be7c-2a90a51d035e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:44.025266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3515cc60-9a12-4164-be7c-2a90a51d035e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:44.033991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3515cc60-9a12-4164-be7c-2a90a51d035e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:44.034498 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3515cc60-9a12-4164-be7c-2a90a51d035e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:44.035357 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3515cc60-9a12-4164-be7c-2a90a51d035e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:44.035851 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3515cc60-9a12-4164-be7c-2a90a51d035e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:44.248219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3515cc60-9a12-4164-be7c-2a90a51d035e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:44.258976 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3515cc60-9a12-4164-be7c-2a90a51d035e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:44.260749 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3515cc60-9a12-4164-be7c-2a90a51d035e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:44.262022 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3515cc60-9a12-4164-be7c-2a90a51d035e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.241719 Apr 14 16:14:44.262661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 312/618] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:44 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:44.570716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a022bce8-4264-4878-ad8b-6d05f14c14de tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:44.571387 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a022bce8-4264-4878-ad8b-6d05f14c14de tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:44.580247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a022bce8-4264-4878-ad8b-6d05f14c14de tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:44.580759 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a022bce8-4264-4878-ad8b-6d05f14c14de tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:44.581625 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a022bce8-4264-4878-ad8b-6d05f14c14de tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:44.582117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a022bce8-4264-4878-ad8b-6d05f14c14de tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:44.761492 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5e973728-e305-4f82-8d0e-5ce8b9f1688a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:44.762195 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5e973728-e305-4f82-8d0e-5ce8b9f1688a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:44.770389 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e973728-e305-4f82-8d0e-5ce8b9f1688a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:44.770893 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e973728-e305-4f82-8d0e-5ce8b9f1688a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:44.771725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e973728-e305-4f82-8d0e-5ce8b9f1688a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:44.772212 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e973728-e305-4f82-8d0e-5ce8b9f1688a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:44.792537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a022bce8-4264-4878-ad8b-6d05f14c14de tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:44.801487 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a022bce8-4264-4878-ad8b-6d05f14c14de tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.234860 Apr 14 16:14:44.802120 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 307/619] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:44 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:44.922721 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0fbc0bd2-564b-4b3c-9cf4-a46ce9891ba3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:44.923428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0fbc0bd2-564b-4b3c-9cf4-a46ce9891ba3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:44.936822 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fbc0bd2-564b-4b3c-9cf4-a46ce9891ba3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:44.937355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fbc0bd2-564b-4b3c-9cf4-a46ce9891ba3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:44.938225 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fbc0bd2-564b-4b3c-9cf4-a46ce9891ba3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:44.938725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fbc0bd2-564b-4b3c-9cf4-a46ce9891ba3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:44.987170 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5e973728-e305-4f82-8d0e-5ce8b9f1688a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:44.997222 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5e973728-e305-4f82-8d0e-5ce8b9f1688a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.239823 Apr 14 16:14:44.997986 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 313/620] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:44 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:45.150484 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0fbc0bd2-564b-4b3c-9cf4-a46ce9891ba3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:45.160386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0fbc0bd2-564b-4b3c-9cf4-a46ce9891ba3 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.242271 Apr 14 16:14:45.161018 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 308/621] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:44 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:45.281812 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-990b41d2-5b0e-4d10-87d5-7c0f43267b58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:45.282484 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-990b41d2-5b0e-4d10-87d5-7c0f43267b58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:45.290918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-990b41d2-5b0e-4d10-87d5-7c0f43267b58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:45.291402 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-990b41d2-5b0e-4d10-87d5-7c0f43267b58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:45.292765 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-990b41d2-5b0e-4d10-87d5-7c0f43267b58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:45.293408 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-990b41d2-5b0e-4d10-87d5-7c0f43267b58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:45.496936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-990b41d2-5b0e-4d10-87d5-7c0f43267b58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:45.506876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-990b41d2-5b0e-4d10-87d5-7c0f43267b58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:45.508562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-990b41d2-5b0e-4d10-87d5-7c0f43267b58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:45.509848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-990b41d2-5b0e-4d10-87d5-7c0f43267b58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.232204 Apr 14 16:14:45.510510 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 314/622] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:45 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:45.821010 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-635540b6-9c05-4711-aa70-b387fdcd7925 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:45.822016 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-635540b6-9c05-4711-aa70-b387fdcd7925 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:45.830622 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-635540b6-9c05-4711-aa70-b387fdcd7925 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:45.831578 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-635540b6-9c05-4711-aa70-b387fdcd7925 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:45.832554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-635540b6-9c05-4711-aa70-b387fdcd7925 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:45.833162 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-635540b6-9c05-4711-aa70-b387fdcd7925 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:46.016893 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3488af6f-99ab-4121-b967-4b866edb7cff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:46.017883 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3488af6f-99ab-4121-b967-4b866edb7cff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:46.026081 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3488af6f-99ab-4121-b967-4b866edb7cff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:46.027198 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3488af6f-99ab-4121-b967-4b866edb7cff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:46.028117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3488af6f-99ab-4121-b967-4b866edb7cff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:46.028679 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3488af6f-99ab-4121-b967-4b866edb7cff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:46.044009 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-635540b6-9c05-4711-aa70-b387fdcd7925 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:46.054286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-635540b6-9c05-4711-aa70-b387fdcd7925 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.238288 Apr 14 16:14:46.055519 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 309/623] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:45 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:46.180039 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f3726046-d68b-45c9-96c1-011744b5a3ed tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:46.180720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f3726046-d68b-45c9-96c1-011744b5a3ed tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:46.189731 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f3726046-d68b-45c9-96c1-011744b5a3ed tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:46.190280 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f3726046-d68b-45c9-96c1-011744b5a3ed tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:46.191149 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f3726046-d68b-45c9-96c1-011744b5a3ed tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:46.191644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f3726046-d68b-45c9-96c1-011744b5a3ed tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:46.402033 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f3726046-d68b-45c9-96c1-011744b5a3ed tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:46.403915 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3488af6f-99ab-4121-b967-4b866edb7cff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:46.411676 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f3726046-d68b-45c9-96c1-011744b5a3ed tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.235937 Apr 14 16:14:46.412316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 310/624] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:46 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:46.413354 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3488af6f-99ab-4121-b967-4b866edb7cff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.401413 Apr 14 16:14:46.413968 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 315/625] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:46 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:46.530519 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-581f6188-d447-4f07-b041-af2a4f607c67 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:46.531174 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-581f6188-d447-4f07-b041-af2a4f607c67 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:46.539299 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-581f6188-d447-4f07-b041-af2a4f607c67 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:46.539802 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-581f6188-d447-4f07-b041-af2a4f607c67 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:46.540628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-581f6188-d447-4f07-b041-af2a4f607c67 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:46.541141 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-581f6188-d447-4f07-b041-af2a4f607c67 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:46.739269 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-581f6188-d447-4f07-b041-af2a4f607c67 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:46.750034 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-581f6188-d447-4f07-b041-af2a4f607c67 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:46.751702 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-581f6188-d447-4f07-b041-af2a4f607c67 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:46.752928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-581f6188-d447-4f07-b041-af2a4f607c67 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.226728 Apr 14 16:14:46.753582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 311/626] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:46 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:47.072112 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-49eccf90-1f67-45fb-9788-3d2627f7e25b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:47.072706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-49eccf90-1f67-45fb-9788-3d2627f7e25b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:47.080526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49eccf90-1f67-45fb-9788-3d2627f7e25b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:47.081024 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49eccf90-1f67-45fb-9788-3d2627f7e25b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:47.081918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49eccf90-1f67-45fb-9788-3d2627f7e25b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:47.082401 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49eccf90-1f67-45fb-9788-3d2627f7e25b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:47.287997 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-49eccf90-1f67-45fb-9788-3d2627f7e25b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:47.297835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-49eccf90-1f67-45fb-9788-3d2627f7e25b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.229845 Apr 14 16:14:47.298454 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 316/627] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:47 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:47.429716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a2d6bbcb-9808-43fa-b640-b0e47a8a952c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:47.430357 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a2d6bbcb-9808-43fa-b640-b0e47a8a952c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:47.430790 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-429ffae4-833c-4eb9-bf89-a756fb132aff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:47.431457 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-429ffae4-833c-4eb9-bf89-a756fb132aff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:47.438514 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2d6bbcb-9808-43fa-b640-b0e47a8a952c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:47.439028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2d6bbcb-9808-43fa-b640-b0e47a8a952c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:47.439872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2d6bbcb-9808-43fa-b640-b0e47a8a952c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:47.440379 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2d6bbcb-9808-43fa-b640-b0e47a8a952c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:47.440589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-429ffae4-833c-4eb9-bf89-a756fb132aff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:47.441158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-429ffae4-833c-4eb9-bf89-a756fb132aff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:47.442040 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-429ffae4-833c-4eb9-bf89-a756fb132aff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:47.442537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-429ffae4-833c-4eb9-bf89-a756fb132aff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:47.652851 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a2d6bbcb-9808-43fa-b640-b0e47a8a952c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:47.664390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a2d6bbcb-9808-43fa-b640-b0e47a8a952c tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.238798 Apr 14 16:14:47.674149 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 312/628] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:47 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:47.674367 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-429ffae4-833c-4eb9-bf89-a756fb132aff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:47.679990 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-429ffae4-833c-4eb9-bf89-a756fb132aff tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.252938 Apr 14 16:14:47.681310 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 317/629] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:47 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:47.772619 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cf729d8b-bd5d-448d-adc1-a51e2bf1de54 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:47.773340 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cf729d8b-bd5d-448d-adc1-a51e2bf1de54 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:47.781514 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cf729d8b-bd5d-448d-adc1-a51e2bf1de54 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:47.782055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cf729d8b-bd5d-448d-adc1-a51e2bf1de54 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:47.782890 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cf729d8b-bd5d-448d-adc1-a51e2bf1de54 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:47.783657 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cf729d8b-bd5d-448d-adc1-a51e2bf1de54 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:47.989664 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cf729d8b-bd5d-448d-adc1-a51e2bf1de54 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:48.000358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cf729d8b-bd5d-448d-adc1-a51e2bf1de54 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:48.002058 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cf729d8b-bd5d-448d-adc1-a51e2bf1de54 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:48.003411 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cf729d8b-bd5d-448d-adc1-a51e2bf1de54 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.234814 Apr 14 16:14:48.004036 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 313/630] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:47 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:48.316070 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cf4f34ce-6d3f-41d0-9bc9-9a16f953a307 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:48.316652 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cf4f34ce-6d3f-41d0-9bc9-9a16f953a307 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:48.325781 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cf4f34ce-6d3f-41d0-9bc9-9a16f953a307 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:48.326284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cf4f34ce-6d3f-41d0-9bc9-9a16f953a307 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:48.327117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cf4f34ce-6d3f-41d0-9bc9-9a16f953a307 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:48.327608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cf4f34ce-6d3f-41d0-9bc9-9a16f953a307 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:48.535067 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cf4f34ce-6d3f-41d0-9bc9-9a16f953a307 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:48.543913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cf4f34ce-6d3f-41d0-9bc9-9a16f953a307 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.232030 Apr 14 16:14:48.544527 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 318/631] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:48 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:48.683420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a5c397e9-25a3-4f58-a651-cc446c614e76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:48.684028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a5c397e9-25a3-4f58-a651-cc446c614e76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:48.691868 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5c397e9-25a3-4f58-a651-cc446c614e76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:48.692407 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5c397e9-25a3-4f58-a651-cc446c614e76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:48.693308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5c397e9-25a3-4f58-a651-cc446c614e76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:48.693783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5c397e9-25a3-4f58-a651-cc446c614e76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:48.700124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7283f18e-8b31-4be1-b1b5-1e2f98245e91 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:48.700796 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7283f18e-8b31-4be1-b1b5-1e2f98245e91 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:48.708655 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7283f18e-8b31-4be1-b1b5-1e2f98245e91 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:48.709198 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7283f18e-8b31-4be1-b1b5-1e2f98245e91 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:48.710040 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7283f18e-8b31-4be1-b1b5-1e2f98245e91 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:48.710534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7283f18e-8b31-4be1-b1b5-1e2f98245e91 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:48.903083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a5c397e9-25a3-4f58-a651-cc446c614e76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:48.913925 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a5c397e9-25a3-4f58-a651-cc446c614e76 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.234991 Apr 14 16:14:48.914577 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 314/632] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:48 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:48.916587 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7283f18e-8b31-4be1-b1b5-1e2f98245e91 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:48.925694 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7283f18e-8b31-4be1-b1b5-1e2f98245e91 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.230265 Apr 14 16:14:48.926315 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 319/633] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:48 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:49.022613 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e57153c5-3e11-4ec5-a0f0-21b6da003bf6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:49.023280 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e57153c5-3e11-4ec5-a0f0-21b6da003bf6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:49.031404 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e57153c5-3e11-4ec5-a0f0-21b6da003bf6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:49.031910 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e57153c5-3e11-4ec5-a0f0-21b6da003bf6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:49.032750 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e57153c5-3e11-4ec5-a0f0-21b6da003bf6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:49.033565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e57153c5-3e11-4ec5-a0f0-21b6da003bf6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:49.244206 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e57153c5-3e11-4ec5-a0f0-21b6da003bf6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:49.254912 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e57153c5-3e11-4ec5-a0f0-21b6da003bf6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:49.256609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e57153c5-3e11-4ec5-a0f0-21b6da003bf6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:49.257881 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e57153c5-3e11-4ec5-a0f0-21b6da003bf6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.239326 Apr 14 16:14:49.258510 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 315/634] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:49 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:49.563288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2a955533-6942-453e-afc7-bebfddbdd6a8 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:49.563868 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2a955533-6942-453e-afc7-bebfddbdd6a8 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:49.572200 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2a955533-6942-453e-afc7-bebfddbdd6a8 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:49.572676 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2a955533-6942-453e-afc7-bebfddbdd6a8 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:49.574598 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2a955533-6942-453e-afc7-bebfddbdd6a8 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:49.575094 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2a955533-6942-453e-afc7-bebfddbdd6a8 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:49.761578 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bbab97c9-9d3d-42db-9bdd-cd8a0d05ce4d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:49.762923 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bbab97c9-9d3d-42db-9bdd-cd8a0d05ce4d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:49.771069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bbab97c9-9d3d-42db-9bdd-cd8a0d05ce4d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:49.771582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bbab97c9-9d3d-42db-9bdd-cd8a0d05ce4d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:49.772439 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bbab97c9-9d3d-42db-9bdd-cd8a0d05ce4d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:49.772937 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bbab97c9-9d3d-42db-9bdd-cd8a0d05ce4d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:49.931169 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bbab97c9-9d3d-42db-9bdd-cd8a0d05ce4d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "POST /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/action" status: 202 len: 0 microversion: 2.1 time: 0.174249 Apr 14 16:14:49.935679 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 316/635] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:14:49 2021] POST /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:14:49.938490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5f9557cb-3a5a-46a9-b829-491e023b4db6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:49.939214 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5f9557cb-3a5a-46a9-b829-491e023b4db6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:49.947738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f9557cb-3a5a-46a9-b829-491e023b4db6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:49.948488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f9557cb-3a5a-46a9-b829-491e023b4db6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:49.949385 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f9557cb-3a5a-46a9-b829-491e023b4db6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:49.949887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f9557cb-3a5a-46a9-b829-491e023b4db6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:49.968766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2a955533-6942-453e-afc7-bebfddbdd6a8 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:50.001000 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2a955533-6942-453e-afc7-bebfddbdd6a8 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.441914 Apr 14 16:14:50.002035 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 320/636] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:49 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:50.016563 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-dc5a3af8-a71a-491f-a9bf-cb79b3d426eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:50.017348 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-dc5a3af8-a71a-491f-a9bf-cb79b3d426eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:50.025340 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc5a3af8-a71a-491f-a9bf-cb79b3d426eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:50.025855 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc5a3af8-a71a-491f-a9bf-cb79b3d426eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:50.026705 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc5a3af8-a71a-491f-a9bf-cb79b3d426eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:50.027196 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc5a3af8-a71a-491f-a9bf-cb79b3d426eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:50.317411 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-dc5a3af8-a71a-491f-a9bf-cb79b3d426eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:50.326015 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5f9557cb-3a5a-46a9-b829-491e023b4db6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:50.338007 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5f9557cb-3a5a-46a9-b829-491e023b4db6 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.403768 Apr 14 16:14:50.348544 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 317/637] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:49 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:50.348544 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-59515662-6d8d-4a45-9a50-a64f828de70a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:50.348831 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-dc5a3af8-a71a-491f-a9bf-cb79b3d426eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1751 microversion: 2.1 time: 0.331208 Apr 14 16:14:50.348916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-59515662-6d8d-4a45-9a50-a64f828de70a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:50.349002 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 321/638] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:50 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1751 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:50.349952 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0fe917fe-1254-4a83-bb17-8d84744e721f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:50.350615 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0fe917fe-1254-4a83-bb17-8d84744e721f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:50.352118 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59515662-6d8d-4a45-9a50-a64f828de70a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:50.352915 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59515662-6d8d-4a45-9a50-a64f828de70a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:50.353495 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59515662-6d8d-4a45-9a50-a64f828de70a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:50.353992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59515662-6d8d-4a45-9a50-a64f828de70a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:50.358600 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fe917fe-1254-4a83-bb17-8d84744e721f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:50.359102 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fe917fe-1254-4a83-bb17-8d84744e721f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:50.360003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fe917fe-1254-4a83-bb17-8d84744e721f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:50.360501 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fe917fe-1254-4a83-bb17-8d84744e721f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:50.563264 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0fe917fe-1254-4a83-bb17-8d84744e721f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:50.574609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0fe917fe-1254-4a83-bb17-8d84744e721f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:50.576341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0fe917fe-1254-4a83-bb17-8d84744e721f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:50.577682 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0fe917fe-1254-4a83-bb17-8d84744e721f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.231635 Apr 14 16:14:50.578354 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 322/639] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:50 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:50.703092 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-59515662-6d8d-4a45-9a50-a64f828de70a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:50.713542 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-59515662-6d8d-4a45-9a50-a64f828de70a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.373479 Apr 14 16:14:50.714912 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 318/640] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:50 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:51.019713 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5a7816ec-6435-47c3-b5b4-d41effe80c96 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:51.020531 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5a7816ec-6435-47c3-b5b4-d41effe80c96 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:51.029628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a7816ec-6435-47c3-b5b4-d41effe80c96 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:51.030224 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a7816ec-6435-47c3-b5b4-d41effe80c96 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:51.031144 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a7816ec-6435-47c3-b5b4-d41effe80c96 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:51.031715 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a7816ec-6435-47c3-b5b4-d41effe80c96 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:51.250474 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5a7816ec-6435-47c3-b5b4-d41effe80c96 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:51.259321 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5a7816ec-6435-47c3-b5b4-d41effe80c96 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.243876 Apr 14 16:14:51.259951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 323/641] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:51 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:51.356035 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c7f212d5-0636-47e6-ae9f-a239f1b0e0eb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:51.357429 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c7f212d5-0636-47e6-ae9f-a239f1b0e0eb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:51.366971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9237db8d-06f6-48ab-801e-1808f056d429 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:51.367684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9237db8d-06f6-48ab-801e-1808f056d429 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:51.375710 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c7f212d5-0636-47e6-ae9f-a239f1b0e0eb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:51.376225 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c7f212d5-0636-47e6-ae9f-a239f1b0e0eb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:51.377109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c7f212d5-0636-47e6-ae9f-a239f1b0e0eb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:51.377608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c7f212d5-0636-47e6-ae9f-a239f1b0e0eb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:51.389325 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9237db8d-06f6-48ab-801e-1808f056d429 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:51.389840 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9237db8d-06f6-48ab-801e-1808f056d429 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:51.390699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9237db8d-06f6-48ab-801e-1808f056d429 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:51.391194 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9237db8d-06f6-48ab-801e-1808f056d429 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:51.593197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c7f212d5-0636-47e6-ae9f-a239f1b0e0eb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:51.596897 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9237db8d-06f6-48ab-801e-1808f056d429 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:51.602790 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c7f212d5-0636-47e6-ae9f-a239f1b0e0eb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1566 microversion: 2.1 time: 0.250789 Apr 14 16:14:51.603430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 319/642] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:51 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1566 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:51.606703 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9237db8d-06f6-48ab-801e-1808f056d429 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.243617 Apr 14 16:14:51.607517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 324/643] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:51 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:51.617148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7d9269b7-7fb4-4205-81ba-09953c58cdac tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:51.617819 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7d9269b7-7fb4-4205-81ba-09953c58cdac tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:51.626817 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d9269b7-7fb4-4205-81ba-09953c58cdac tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:51.627322 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d9269b7-7fb4-4205-81ba-09953c58cdac tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:51.628163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d9269b7-7fb4-4205-81ba-09953c58cdac tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:51.628789 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d9269b7-7fb4-4205-81ba-09953c58cdac tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:51.744357 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0a9a58a7-9e0e-4e03-b883-181bb62da2d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:51.745874 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0a9a58a7-9e0e-4e03-b883-181bb62da2d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:51.754626 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0a9a58a7-9e0e-4e03-b883-181bb62da2d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:51.755133 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0a9a58a7-9e0e-4e03-b883-181bb62da2d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:51.755958 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0a9a58a7-9e0e-4e03-b883-181bb62da2d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:51.756637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0a9a58a7-9e0e-4e03-b883-181bb62da2d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:51.830692 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7d9269b7-7fb4-4205-81ba-09953c58cdac tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:51.841177 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7d9269b7-7fb4-4205-81ba-09953c58cdac tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:51.842876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7d9269b7-7fb4-4205-81ba-09953c58cdac tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:51.844120 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7d9269b7-7fb4-4205-81ba-09953c58cdac tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.239688 Apr 14 16:14:51.844749 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 320/644] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:51 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:52.141170 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0a9a58a7-9e0e-4e03-b883-181bb62da2d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:52.150326 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0a9a58a7-9e0e-4e03-b883-181bb62da2d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.410228 Apr 14 16:14:52.151051 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 325/645] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:51 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:52.277962 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-26e64a1f-cad2-472d-aaae-d4e1cd202718 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:52.278630 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-26e64a1f-cad2-472d-aaae-d4e1cd202718 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:52.287019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26e64a1f-cad2-472d-aaae-d4e1cd202718 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:52.288904 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26e64a1f-cad2-472d-aaae-d4e1cd202718 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:52.288904 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26e64a1f-cad2-472d-aaae-d4e1cd202718 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:52.288904 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26e64a1f-cad2-472d-aaae-d4e1cd202718 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:52.508687 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-26e64a1f-cad2-472d-aaae-d4e1cd202718 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:52.522989 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-26e64a1f-cad2-472d-aaae-d4e1cd202718 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1514 microversion: 2.1 time: 0.249144 Apr 14 16:14:52.523801 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 321/646] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:52 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:52.623321 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5c95ddc3-51c4-4f42-b490-c107d0a58d5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:52.624121 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5c95ddc3-51c4-4f42-b490-c107d0a58d5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:52.634493 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5c95ddc3-51c4-4f42-b490-c107d0a58d5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:52.635812 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5c95ddc3-51c4-4f42-b490-c107d0a58d5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:52.636627 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-047aeca7-be17-4251-99f3-4000d0cf7fca tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:52.637536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-047aeca7-be17-4251-99f3-4000d0cf7fca tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:52.637922 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5c95ddc3-51c4-4f42-b490-c107d0a58d5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:52.638511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5c95ddc3-51c4-4f42-b490-c107d0a58d5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:52.649538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-047aeca7-be17-4251-99f3-4000d0cf7fca tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:52.650059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-047aeca7-be17-4251-99f3-4000d0cf7fca tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:52.651032 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-047aeca7-be17-4251-99f3-4000d0cf7fca tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:52.651773 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-047aeca7-be17-4251-99f3-4000d0cf7fca tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:52.886483 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-047aeca7-be17-4251-99f3-4000d0cf7fca tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:52.897302 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-047aeca7-be17-4251-99f3-4000d0cf7fca tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.274285 Apr 14 16:14:52.898189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 322/647] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:52 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:52.903410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-f7394014-fcb0-405a-88af-a76202f23211 req-23c4f9ab-39c1-4b39-ab74-0bdcbb62663c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e0bacb9-233d-4561-9882-6c9619a84e69", "name": "network-vif-deleted", "tag": "a6efdcb1-cac1-4a1b-88d3-3d4a36081e9f"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:52.905199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:14:52.905199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:14:52.914813 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-f7394014-fcb0-405a-88af-a76202f23211 req-23c4f9ab-39c1-4b39-ab74-0bdcbb62663c service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:52.915326 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-f7394014-fcb0-405a-88af-a76202f23211 req-23c4f9ab-39c1-4b39-ab74-0bdcbb62663c service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:52.918378 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5c95ddc3-51c4-4f42-b490-c107d0a58d5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:52.929915 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5c95ddc3-51c4-4f42-b490-c107d0a58d5b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1546 microversion: 2.1 time: 0.313185 Apr 14 16:14:52.930536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 326/648] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:52 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1546 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:52.936158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a2c1bed9-901e-4571-8985-a0f62c2605e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:52.936818 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a2c1bed9-901e-4571-8985-a0f62c2605e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:52.944956 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2c1bed9-901e-4571-8985-a0f62c2605e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:52.945613 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2c1bed9-901e-4571-8985-a0f62c2605e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:52.946280 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2c1bed9-901e-4571-8985-a0f62c2605e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:52.946766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2c1bed9-901e-4571-8985-a0f62c2605e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:52.951088 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-f7394014-fcb0-405a-88af-a76202f23211 req-23c4f9ab-39c1-4b39-ab74-0bdcbb62663c service nova] Creating event network-vif-deleted:a6efdcb1-cac1-4a1b-88d3-3d4a36081e9f for instance 3e0bacb9-233d-4561-9882-6c9619a84e69 on hv-cinder-78626 Apr 14 16:14:52.956769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-f7394014-fcb0-405a-88af-a76202f23211 req-23c4f9ab-39c1-4b39-ab74-0bdcbb62663c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057535 Apr 14 16:14:52.957788 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 323/649] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:14:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:14:52.965199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-19659059-3da4-4ce8-863d-60404f46a0fb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:52.965728 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-19659059-3da4-4ce8-863d-60404f46a0fb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:52.974235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19659059-3da4-4ce8-863d-60404f46a0fb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:52.974758 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19659059-3da4-4ce8-863d-60404f46a0fb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:52.975621 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19659059-3da4-4ce8-863d-60404f46a0fb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:52.976117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19659059-3da4-4ce8-863d-60404f46a0fb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:53.173600 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-19659059-3da4-4ce8-863d-60404f46a0fb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] HTTP exception thrown: Cannot 'detach_volume' instance 0a704e48-ff08-4961-9c93-7a0fdf04543d while it is in vm_state rescued Apr 14 16:14:53.174283 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-19659059-3da4-4ce8-863d-60404f46a0fb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Returning 409 to user: Cannot 'detach_volume' instance 0a704e48-ff08-4961-9c93-7a0fdf04543d while it is in vm_state rescued {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:14:53.175211 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-19659059-3da4-4ce8-863d-60404f46a0fb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/os-volume_attachments/18a07076-8fd4-4767-85c6-15611ad95ab6" status: 409 len: 152 microversion: 2.1 time: 0.216245 Apr 14 16:14:53.175887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 324/650] 10.222.0.60 () {58 vars in 1406 bytes} [Wed Apr 14 16:14:52 2021] DELETE /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/os-volume_attachments/18a07076-8fd4-4767-85c6-15611ad95ab6 => generated 152 bytes in 218 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 16:14:53.178272 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a2c1bed9-901e-4571-8985-a0f62c2605e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:53.180643 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a13afdef-15e1-4502-9c32-703cb759a2c6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:53.181405 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a13afdef-15e1-4502-9c32-703cb759a2c6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:53.189161 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a2c1bed9-901e-4571-8985-a0f62c2605e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:53.189338 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a13afdef-15e1-4502-9c32-703cb759a2c6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:53.189694 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a13afdef-15e1-4502-9c32-703cb759a2c6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:53.190544 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a13afdef-15e1-4502-9c32-703cb759a2c6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:53.190829 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a2c1bed9-901e-4571-8985-a0f62c2605e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:53.191041 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a13afdef-15e1-4502-9c32-703cb759a2c6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:53.192045 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a2c1bed9-901e-4571-8985-a0f62c2605e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.260524 Apr 14 16:14:53.192701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 327/651] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:52 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:53.198279 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1d4782e8-5f05-4b32-a3a0-d65d7095cf93 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:53.198279 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1d4782e8-5f05-4b32-a3a0-d65d7095cf93 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:53.216924 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d4782e8-5f05-4b32-a3a0-d65d7095cf93 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:53.217571 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d4782e8-5f05-4b32-a3a0-d65d7095cf93 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:53.218509 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d4782e8-5f05-4b32-a3a0-d65d7095cf93 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:53.219152 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d4782e8-5f05-4b32-a3a0-d65d7095cf93 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:53.362251 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1d4782e8-5f05-4b32-a3a0-d65d7095cf93 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "POST /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/action" status: 202 len: 0 microversion: 2.1 time: 0.168197 Apr 14 16:14:53.366106 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 328/652] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:14:53 2021] POST /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:14:53.371970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e1209327-106d-454b-ab7b-2d46814ebd13 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:53.372720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e1209327-106d-454b-ab7b-2d46814ebd13 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:53.380858 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e1209327-106d-454b-ab7b-2d46814ebd13 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:53.381402 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e1209327-106d-454b-ab7b-2d46814ebd13 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:53.382245 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e1209327-106d-454b-ab7b-2d46814ebd13 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:53.382734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e1209327-106d-454b-ab7b-2d46814ebd13 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:53.390279 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a13afdef-15e1-4502-9c32-703cb759a2c6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:53.401673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a13afdef-15e1-4502-9c32-703cb759a2c6 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.224102 Apr 14 16:14:53.402315 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 325/653] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:53 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:53.544271 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f03a62dc-bc4b-4a99-abd5-63efd3365b71 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:53.545499 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f03a62dc-bc4b-4a99-abd5-63efd3365b71 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:53.558144 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f03a62dc-bc4b-4a99-abd5-63efd3365b71 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:53.558144 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f03a62dc-bc4b-4a99-abd5-63efd3365b71 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:53.558144 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f03a62dc-bc4b-4a99-abd5-63efd3365b71 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:53.560355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f03a62dc-bc4b-4a99-abd5-63efd3365b71 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:53.648938 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f03a62dc-bc4b-4a99-abd5-63efd3365b71 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:53.649505 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f03a62dc-bc4b-4a99-abd5-63efd3365b71 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:53.650132 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-f03a62dc-bc4b-4a99-abd5-63efd3365b71 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lazy-loading 'fault' on Instance uuid 3e0bacb9-233d-4561-9882-6c9619a84e69 {{(pid=99335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:14:53.660399 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e1209327-106d-454b-ab7b-2d46814ebd13 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:53.672261 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e1209327-106d-454b-ab7b-2d46814ebd13 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1554 microversion: 2.1 time: 0.304513 Apr 14 16:14:53.673228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 329/654] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:53 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1554 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:53.735618 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f03a62dc-bc4b-4a99-abd5-63efd3365b71 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a19cff22a01451e8d454b8a8f4cde89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a4298bacf14cd493bcec2e3543ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:53.744005 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f03a62dc-bc4b-4a99-abd5-63efd3365b71 tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 200 len: 1308 microversion: 2.1 time: 0.205463 Apr 14 16:14:53.744846 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 326/655] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:53 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 1308 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:53.915960 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c1a2a933-488f-4bf0-b0be-127e6b4b05aa tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:53.918108 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c1a2a933-488f-4bf0-b0be-127e6b4b05aa tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:53.925946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1a2a933-488f-4bf0-b0be-127e6b4b05aa tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:53.926456 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1a2a933-488f-4bf0-b0be-127e6b4b05aa tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:53.927293 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1a2a933-488f-4bf0-b0be-127e6b4b05aa tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:53.927784 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1a2a933-488f-4bf0-b0be-127e6b4b05aa tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:54.212129 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fab17c28-8402-4ee2-9c22-c1f26f621156 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:54.212805 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fab17c28-8402-4ee2-9c22-c1f26f621156 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:54.221134 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fab17c28-8402-4ee2-9c22-c1f26f621156 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:54.221658 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fab17c28-8402-4ee2-9c22-c1f26f621156 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:54.222517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fab17c28-8402-4ee2-9c22-c1f26f621156 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:54.223018 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fab17c28-8402-4ee2-9c22-c1f26f621156 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:54.306979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c1a2a933-488f-4bf0-b0be-127e6b4b05aa tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:54.317230 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c1a2a933-488f-4bf0-b0be-127e6b4b05aa tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.405303 Apr 14 16:14:54.318064 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 330/656] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:53 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:54.420975 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-44bf6dbc-8136-4cb0-b8bb-d724ecbaf5a5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:54.421866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-44bf6dbc-8136-4cb0-b8bb-d724ecbaf5a5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:54.423555 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fab17c28-8402-4ee2-9c22-c1f26f621156 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:54.430287 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44bf6dbc-8136-4cb0-b8bb-d724ecbaf5a5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:54.430806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44bf6dbc-8136-4cb0-b8bb-d724ecbaf5a5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:54.431865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44bf6dbc-8136-4cb0-b8bb-d724ecbaf5a5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:54.432913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44bf6dbc-8136-4cb0-b8bb-d724ecbaf5a5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:54.435388 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fab17c28-8402-4ee2-9c22-c1f26f621156 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:54.437320 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fab17c28-8402-4ee2-9c22-c1f26f621156 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:54.438631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fab17c28-8402-4ee2-9c22-c1f26f621156 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.230622 Apr 14 16:14:54.439279 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 327/657] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:54 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:14:54.691541 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6d774857-9b53-411c-a9a8-994f107a22bb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:54.692362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6d774857-9b53-411c-a9a8-994f107a22bb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:54.701261 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6d774857-9b53-411c-a9a8-994f107a22bb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:54.702150 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6d774857-9b53-411c-a9a8-994f107a22bb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:54.703020 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6d774857-9b53-411c-a9a8-994f107a22bb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:54.703526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6d774857-9b53-411c-a9a8-994f107a22bb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:54.752397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-44bf6dbc-8136-4cb0-b8bb-d724ecbaf5a5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:54.761720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-44bf6dbc-8136-4cb0-b8bb-d724ecbaf5a5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.345829 Apr 14 16:14:54.762462 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 331/658] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:54 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:54.767202 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7211d7a0-acec-4530-929a-0ef243a5768b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:54.768290 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7211d7a0-acec-4530-929a-0ef243a5768b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] [instance: 3e0bacb9-233d-4561-9882-6c9619a84e69] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:54.775672 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7211d7a0-acec-4530-929a-0ef243a5768b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:54.776879 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7211d7a0-acec-4530-929a-0ef243a5768b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:54.777782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7211d7a0-acec-4530-929a-0ef243a5768b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:54.778278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7211d7a0-acec-4530-929a-0ef243a5768b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:54.832100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-7211d7a0-acec-4530-929a-0ef243a5768b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] HTTP exception thrown: Instance 3e0bacb9-233d-4561-9882-6c9619a84e69 could not be found. Apr 14 16:14:54.832694 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7211d7a0-acec-4530-929a-0ef243a5768b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] Returning 404 to user: Instance 3e0bacb9-233d-4561-9882-6c9619a84e69 could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:14:54.833664 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7211d7a0-acec-4530-929a-0ef243a5768b tempest-AttachVolumeNegativeTest-1940544776 tempest-AttachVolumeNegativeTest-1940544776-project] 10.222.0.60 "GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69" status: 404 len: 111 microversion: 2.1 time: 0.070209 Apr 14 16:14:54.834287 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 332/659] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:54 2021] GET /compute/v2.1/servers/3e0bacb9-233d-4561-9882-6c9619a84e69 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:14:54.909047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6d774857-9b53-411c-a9a8-994f107a22bb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:54.919172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6d774857-9b53-411c-a9a8-994f107a22bb tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1554 microversion: 2.1 time: 0.231789 Apr 14 16:14:54.919825 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 328/660] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:54 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1554 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:55.336054 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-385b1a3d-b7e3-4b7a-8746-221920d0412b tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:55.336727 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-385b1a3d-b7e3-4b7a-8746-221920d0412b tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:55.345295 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-385b1a3d-b7e3-4b7a-8746-221920d0412b tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:55.345809 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-385b1a3d-b7e3-4b7a-8746-221920d0412b tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:55.346654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-385b1a3d-b7e3-4b7a-8746-221920d0412b tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:55.347146 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-385b1a3d-b7e3-4b7a-8746-221920d0412b tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:55.458879 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-45923aa1-722e-48af-938e-c471c9842b2b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:55.459553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-45923aa1-722e-48af-938e-c471c9842b2b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:55.467782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45923aa1-722e-48af-938e-c471c9842b2b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:55.468293 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45923aa1-722e-48af-938e-c471c9842b2b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:55.469170 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45923aa1-722e-48af-938e-c471c9842b2b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:55.469678 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45923aa1-722e-48af-938e-c471c9842b2b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:55.584798 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-385b1a3d-b7e3-4b7a-8746-221920d0412b tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:55.594983 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-385b1a3d-b7e3-4b7a-8746-221920d0412b tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.263092 Apr 14 16:14:55.595836 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 333/661] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:55 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:55.779794 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-91feead1-78d7-47c8-83cf-8a5ff874552f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:55.780356 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-91feead1-78d7-47c8-83cf-8a5ff874552f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:55.789097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-91feead1-78d7-47c8-83cf-8a5ff874552f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:55.789628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-91feead1-78d7-47c8-83cf-8a5ff874552f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:55.790493 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-91feead1-78d7-47c8-83cf-8a5ff874552f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:55.790988 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-91feead1-78d7-47c8-83cf-8a5ff874552f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:56.001875 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-91feead1-78d7-47c8-83cf-8a5ff874552f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:56.011601 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-91feead1-78d7-47c8-83cf-8a5ff874552f tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.236048 Apr 14 16:14:56.012726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 334/662] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:55 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:56.018844 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-46222a9a-0bc0-4d6b-9131-66e2399516d9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:56.020028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-46222a9a-0bc0-4d6b-9131-66e2399516d9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:56.034444 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-46222a9a-0bc0-4d6b-9131-66e2399516d9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:56.034887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-46222a9a-0bc0-4d6b-9131-66e2399516d9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:56.035745 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-46222a9a-0bc0-4d6b-9131-66e2399516d9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:56.036240 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-46222a9a-0bc0-4d6b-9131-66e2399516d9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:56.169674 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-45923aa1-722e-48af-938e-c471c9842b2b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:56.179807 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-45923aa1-722e-48af-938e-c471c9842b2b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:56.181497 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-45923aa1-722e-48af-938e-c471c9842b2b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:56.183112 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-45923aa1-722e-48af-938e-c471c9842b2b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.728465 Apr 14 16:14:56.183909 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 329/663] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:55 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:14:56.240717 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-46222a9a-0bc0-4d6b-9131-66e2399516d9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:56.251192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-46222a9a-0bc0-4d6b-9131-66e2399516d9 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1554 microversion: 2.1 time: 0.237301 Apr 14 16:14:56.251840 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 335/664] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:56 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:56.617549 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8fa2a8b4-ee0f-46e9-a56b-085901b6cec6 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:56.618262 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8fa2a8b4-ee0f-46e9-a56b-085901b6cec6 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:56.626535 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8fa2a8b4-ee0f-46e9-a56b-085901b6cec6 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:56.627038 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8fa2a8b4-ee0f-46e9-a56b-085901b6cec6 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:56.627876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8fa2a8b4-ee0f-46e9-a56b-085901b6cec6 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:56.628363 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8fa2a8b4-ee0f-46e9-a56b-085901b6cec6 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:56.772318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-0d9b4177-3762-49bd-8277-5b44526a971b req-72d046f8-73d2-4430-b36b-3720f5ee849c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bca69cc6-ca35-4146-8a19-b3e35097b152", "name": "network-vif-plugged", "status": "completed", "tag": "795f1499-91ff-4e4d-8ef8-0d1a0241293e"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:56.774713 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:14:56.774713 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:14:56.784479 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-0d9b4177-3762-49bd-8277-5b44526a971b req-72d046f8-73d2-4430-b36b-3720f5ee849c service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:56.784959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-0d9b4177-3762-49bd-8277-5b44526a971b req-72d046f8-73d2-4430-b36b-3720f5ee849c service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:56.802960 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-0d9b4177-3762-49bd-8277-5b44526a971b req-72d046f8-73d2-4430-b36b-3720f5ee849c service nova] Creating event network-vif-plugged:795f1499-91ff-4e4d-8ef8-0d1a0241293e for instance bca69cc6-ca35-4146-8a19-b3e35097b152 on hv-cinder-78626 Apr 14 16:14:56.809019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-0d9b4177-3762-49bd-8277-5b44526a971b req-72d046f8-73d2-4430-b36b-3720f5ee849c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040670 Apr 14 16:14:56.809892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 336/665] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:14:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:14:56.944939 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8fa2a8b4-ee0f-46e9-a56b-085901b6cec6 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:56.955069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8fa2a8b4-ee0f-46e9-a56b-085901b6cec6 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.342755 Apr 14 16:14:56.955724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 330/666] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:56 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:57.031298 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-90b5c6b2-4385-4a6d-8898-468de744b78c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:57.032232 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-90b5c6b2-4385-4a6d-8898-468de744b78c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:57.041252 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-90b5c6b2-4385-4a6d-8898-468de744b78c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:57.042341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-90b5c6b2-4385-4a6d-8898-468de744b78c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:57.043271 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-90b5c6b2-4385-4a6d-8898-468de744b78c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:57.043760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-90b5c6b2-4385-4a6d-8898-468de744b78c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:57.205428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-85c2760e-4b28-47b5-8d9e-700efdf98502 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:57.206140 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-85c2760e-4b28-47b5-8d9e-700efdf98502 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:57.214205 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85c2760e-4b28-47b5-8d9e-700efdf98502 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:57.214718 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85c2760e-4b28-47b5-8d9e-700efdf98502 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:57.215565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85c2760e-4b28-47b5-8d9e-700efdf98502 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:57.216059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85c2760e-4b28-47b5-8d9e-700efdf98502 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:57.337668 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-90b5c6b2-4385-4a6d-8898-468de744b78c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:57.347206 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-90b5c6b2-4385-4a6d-8898-468de744b78c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.321145 Apr 14 16:14:57.348318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 337/667] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:57 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:57.353515 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0489cf12-cf4e-4cfc-8b72-9999b4b4de1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:57.354690 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0489cf12-cf4e-4cfc-8b72-9999b4b4de1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:57.362664 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0489cf12-cf4e-4cfc-8b72-9999b4b4de1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:57.363184 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0489cf12-cf4e-4cfc-8b72-9999b4b4de1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:57.364036 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0489cf12-cf4e-4cfc-8b72-9999b4b4de1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:57.364532 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0489cf12-cf4e-4cfc-8b72-9999b4b4de1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:57.503552 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-85c2760e-4b28-47b5-8d9e-700efdf98502 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:57.514681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-85c2760e-4b28-47b5-8d9e-700efdf98502 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:57.516388 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-85c2760e-4b28-47b5-8d9e-700efdf98502 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:57.517664 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-85c2760e-4b28-47b5-8d9e-700efdf98502 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.316472 Apr 14 16:14:57.518601 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 331/668] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:57 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:14:57.594829 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0489cf12-cf4e-4cfc-8b72-9999b4b4de1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:57.603270 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0489cf12-cf4e-4cfc-8b72-9999b4b4de1f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1554 microversion: 2.1 time: 0.253788 Apr 14 16:14:57.604286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 338/669] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:57 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:57.973996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5f903d04-afba-4913-95ae-b6dfcccaf2ab tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:57.975253 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5f903d04-afba-4913-95ae-b6dfcccaf2ab tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:57.983403 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f903d04-afba-4913-95ae-b6dfcccaf2ab tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:57.983921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f903d04-afba-4913-95ae-b6dfcccaf2ab tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:57.984768 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f903d04-afba-4913-95ae-b6dfcccaf2ab tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:57.985300 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f903d04-afba-4913-95ae-b6dfcccaf2ab tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:58.191771 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5f903d04-afba-4913-95ae-b6dfcccaf2ab tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:58.201976 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5f903d04-afba-4913-95ae-b6dfcccaf2ab tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.232181 Apr 14 16:14:58.202615 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 332/670] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:57 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:58.365677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b070cba4-7e0d-482a-9daf-65a218722a07 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:58.366482 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b070cba4-7e0d-482a-9daf-65a218722a07 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:58.375308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b070cba4-7e0d-482a-9daf-65a218722a07 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:58.375926 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b070cba4-7e0d-482a-9daf-65a218722a07 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:58.376849 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b070cba4-7e0d-482a-9daf-65a218722a07 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:58.377464 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b070cba4-7e0d-482a-9daf-65a218722a07 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:58.487510 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8c8945f9-9431-4eed-ab7b-07c3af1cccf7 tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] Action: 'create', calling method: .version_select at 0x7ff58d31f268>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-132799129", "metadata": {"Type": "work"}}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:58.489175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8c8945f9-9431-4eed-ab7b-07c3af1cccf7 tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:14:58.490064 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8c8945f9-9431-4eed-ab7b-07c3af1cccf7 tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.134399 Apr 14 16:14:58.490661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 339/671] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Apr 14 16:14:58 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 16:14:58.500961 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2053f5a1-92e3-498b-88c1-c3ca9b504180 tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] Action: 'create', calling method: .version_select at 0x7ff58d4f2048>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1758678350", "metadata": {"Type": "work"}}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:58.502298 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2053f5a1-92e3-498b-88c1-c3ca9b504180 tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:14:58.503160 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2053f5a1-92e3-498b-88c1-c3ca9b504180 tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006005 Apr 14 16:14:58.503762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 340/672] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Apr 14 16:14:58 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 14 16:14:58.513894 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-69a1baf9-0fdf-4f0a-9a4a-ac76e286322f tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] Action: 'create', calling method: .version_select at 0x7ff58e0ce2f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1741354650", "metadata": {"Type": "work"}}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:58.515191 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-69a1baf9-0fdf-4f0a-9a4a-ac76e286322f tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:14:58.516041 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-69a1baf9-0fdf-4f0a-9a4a-ac76e286322f tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007324 Apr 14 16:14:58.516616 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 341/673] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Apr 14 16:14:58 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 16:14:58.525251 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c65a0d43-3f7f-45e7-8260-890750350a58 tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] Calling method '.version_select at 0x7ff58d4f2950>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:58.580547 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b070cba4-7e0d-482a-9daf-65a218722a07 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:58.592144 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b070cba4-7e0d-482a-9daf-65a218722a07 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1263 microversion: 2.1 time: 0.228536 Apr 14 16:14:58.592284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-c65a0d43-3f7f-45e7-8260-890750350a58 tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] HTTP exception thrown: Volume tempest-invalid-1678115798 could not be found. Apr 14 16:14:58.592826 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c65a0d43-3f7f-45e7-8260-890750350a58 tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] Returning 404 to user: Volume tempest-invalid-1678115798 could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:14:58.592985 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 333/674] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:58 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1263 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:58.594061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c65a0d43-3f7f-45e7-8260-890750350a58 tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1678115798" status: 404 len: 99 microversion: 2.1 time: 0.072391 Apr 14 16:14:58.599107 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9c90d8fb-358d-44da-a770-f113c275a27b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:58.599504 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9c90d8fb-358d-44da-a770-f113c275a27b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:58.599841 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 342/675] 10.222.0.60 () {58 vars in 1208 bytes} [Wed Apr 14 16:14:58 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1678115798 => generated 99 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 14 16:14:58.606428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-eec87583-4e81-48ce-8405-e15d4ab58f29 tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004709 Apr 14 16:14:58.606973 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 343/676] 10.222.0.60 () {58 vars in 1130 bytes} [Wed Apr 14 16:14:58 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 16:14:58.611145 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c90d8fb-358d-44da-a770-f113c275a27b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:58.611145 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c90d8fb-358d-44da-a770-f113c275a27b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:58.611145 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c90d8fb-358d-44da-a770-f113c275a27b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:58.611463 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c90d8fb-358d-44da-a770-f113c275a27b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:58.616795 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-76f1e8ba-a9da-4925-be06-7fc65c97a8df tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003971 Apr 14 16:14:58.617309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 344/677] 10.222.0.60 () {58 vars in 1127 bytes} [Wed Apr 14 16:14:58 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 16:14:58.626522 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a5c2f24e-bf8e-4d35-865e-fd40f69d6175 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:58.627194 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a5c2f24e-bf8e-4d35-865e-fd40f69d6175 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:58.636489 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5c2f24e-bf8e-4d35-865e-fd40f69d6175 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:58.637357 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5c2f24e-bf8e-4d35-865e-fd40f69d6175 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:58.638435 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5c2f24e-bf8e-4d35-865e-fd40f69d6175 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:58.639280 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5c2f24e-bf8e-4d35-865e-fd40f69d6175 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:58.822223 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9c90d8fb-358d-44da-a770-f113c275a27b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:58.833211 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9c90d8fb-358d-44da-a770-f113c275a27b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:58.834901 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9c90d8fb-358d-44da-a770-f113c275a27b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:58.836152 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9c90d8fb-358d-44da-a770-f113c275a27b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.242242 Apr 14 16:14:58.836774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 334/678] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:58 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:14:58.866984 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b327002b-c0a8-49ab-8f86-d08f199ceed8 tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] Calling method '.version_select at 0x7ff58e069378>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:58.875915 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a5c2f24e-bf8e-4d35-865e-fd40f69d6175 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:58.887297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a5c2f24e-bf8e-4d35-865e-fd40f69d6175 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1560 microversion: 2.1 time: 0.264323 Apr 14 16:14:58.888149 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 345/679] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:58 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1560 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:58.954125 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-b327002b-c0a8-49ab-8f86-d08f199ceed8 tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] HTTP exception thrown: Volume 2d4ac6b4-05f2-4505-8abd-36680578bc26 could not be found. Apr 14 16:14:58.954811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b327002b-c0a8-49ab-8f86-d08f199ceed8 tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] Returning 404 to user: Volume 2d4ac6b4-05f2-4505-8abd-36680578bc26 could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:14:58.955728 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b327002b-c0a8-49ab-8f86-d08f199ceed8 tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/2d4ac6b4-05f2-4505-8abd-36680578bc26" status: 404 len: 109 microversion: 2.1 time: 0.117823 Apr 14 16:14:58.956371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 335/680] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Apr 14 16:14:58 2021] DELETE /compute/v2.1/os-volumes/2d4ac6b4-05f2-4505-8abd-36680578bc26 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:14:58.966696 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-dbcb44d8-3482-4fa8-b828-50d7f5f11bcf tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] Calling method '.version_select at 0x7ff591fe5e18>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:59.015044 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ac74c02b-9ae9-4232-b558-18ea7ca49df2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:59.015598 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ac74c02b-9ae9-4232-b558-18ea7ca49df2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:59.024244 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ac74c02b-9ae9-4232-b558-18ea7ca49df2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:59.024761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ac74c02b-9ae9-4232-b558-18ea7ca49df2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:59.025735 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ac74c02b-9ae9-4232-b558-18ea7ca49df2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:59.026424 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ac74c02b-9ae9-4232-b558-18ea7ca49df2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:59.031049 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-dbcb44d8-3482-4fa8-b828-50d7f5f11bcf tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] HTTP exception thrown: Volume f1f993eb-432d-4a84-a001-e6d1522e1b33 could not be found. Apr 14 16:14:59.031738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-dbcb44d8-3482-4fa8-b828-50d7f5f11bcf tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] Returning 404 to user: Volume f1f993eb-432d-4a84-a001-e6d1522e1b33 could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:14:59.032642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-dbcb44d8-3482-4fa8-b828-50d7f5f11bcf tempest-VolumesNegativeTest-1603333637 tempest-VolumesNegativeTest-1603333637-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/f1f993eb-432d-4a84-a001-e6d1522e1b33" status: 404 len: 109 microversion: 2.1 time: 0.070677 Apr 14 16:14:59.033539 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 346/681] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Apr 14 16:14:58 2021] GET /compute/v2.1/os-volumes/f1f993eb-432d-4a84-a001-e6d1522e1b33 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:14:59.202477 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-ac74c02b-9ae9-4232-b558-18ea7ca49df2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lazy-loading 'services' on Instance uuid 0a704e48-ff08-4961-9c93-7a0fdf04543d {{(pid=99335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:14:59.220993 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ded57d5f-5349-433c-b1db-02f34e6f21d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:59.221771 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ded57d5f-5349-433c-b1db-02f34e6f21d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:59.236797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ded57d5f-5349-433c-b1db-02f34e6f21d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:59.237524 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ded57d5f-5349-433c-b1db-02f34e6f21d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:59.238454 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ded57d5f-5349-433c-b1db-02f34e6f21d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:59.238945 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ded57d5f-5349-433c-b1db-02f34e6f21d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:59.357323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ac74c02b-9ae9-4232-b558-18ea7ca49df2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/os-volume_attachments/18a07076-8fd4-4767-85c6-15611ad95ab6" status: 202 len: 0 microversion: 2.1 time: 0.345934 Apr 14 16:14:59.359000 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 336/682] 10.222.0.60 () {58 vars in 1406 bytes} [Wed Apr 14 16:14:59 2021] DELETE /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d/os-volume_attachments/18a07076-8fd4-4767-85c6-15611ad95ab6 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:14:59.503135 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ded57d5f-5349-433c-b1db-02f34e6f21d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:59.517456 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ded57d5f-5349-433c-b1db-02f34e6f21d7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.300577 Apr 14 16:14:59.529067 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 347/683] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:59 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:14:59.612759 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b672e03a-c0ff-44ac-b1bf-f84eb5317bc2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:59.613578 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b672e03a-c0ff-44ac-b1bf-f84eb5317bc2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:59.622916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b672e03a-c0ff-44ac-b1bf-f84eb5317bc2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:59.623430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b672e03a-c0ff-44ac-b1bf-f84eb5317bc2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:59.624292 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b672e03a-c0ff-44ac-b1bf-f84eb5317bc2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:59.624793 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b672e03a-c0ff-44ac-b1bf-f84eb5317bc2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:59.828819 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b672e03a-c0ff-44ac-b1bf-f84eb5317bc2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:14:59.838599 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b672e03a-c0ff-44ac-b1bf-f84eb5317bc2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1451 microversion: 2.1 time: 0.230887 Apr 14 16:14:59.839243 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 337/684] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:59 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1451 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:59.857265 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-06bd6582-00fa-4975-8f38-f329b55325da tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:59.857479 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4f3bd84c-717f-4b53-b851-7d4fbb15831b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:14:59.857945 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-06bd6582-00fa-4975-8f38-f329b55325da tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:59.858282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4f3bd84c-717f-4b53-b851-7d4fbb15831b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:14:59.866217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06bd6582-00fa-4975-8f38-f329b55325da tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:59.866597 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06bd6582-00fa-4975-8f38-f329b55325da tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:59.866807 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4f3bd84c-717f-4b53-b851-7d4fbb15831b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:59.867457 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06bd6582-00fa-4975-8f38-f329b55325da tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:59.867583 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4f3bd84c-717f-4b53-b851-7d4fbb15831b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:59.867957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06bd6582-00fa-4975-8f38-f329b55325da tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:14:59.868750 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4f3bd84c-717f-4b53-b851-7d4fbb15831b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:14:59.869418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4f3bd84c-717f-4b53-b851-7d4fbb15831b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:00.085176 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4f3bd84c-717f-4b53-b851-7d4fbb15831b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:00.094760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-06bd6582-00fa-4975-8f38-f329b55325da tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:00.121610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-06bd6582-00fa-4975-8f38-f329b55325da tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1451 microversion: 2.1 time: 0.258306 Apr 14 16:15:00.122285 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 338/685] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:14:59 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1451 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:00.130511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4f3bd84c-717f-4b53-b851-7d4fbb15831b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:00.132612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4f3bd84c-717f-4b53-b851-7d4fbb15831b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:00.133976 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4f3bd84c-717f-4b53-b851-7d4fbb15831b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.281361 Apr 14 16:15:00.134844 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 348/686] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:14:59 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:15:00.536183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-089af355-c74d-4fde-adc2-48013e2f66c3 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:00.537026 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-089af355-c74d-4fde-adc2-48013e2f66c3 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:00.546541 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-089af355-c74d-4fde-adc2-48013e2f66c3 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:00.547267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-089af355-c74d-4fde-adc2-48013e2f66c3 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:00.548293 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-089af355-c74d-4fde-adc2-48013e2f66c3 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:00.548911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-089af355-c74d-4fde-adc2-48013e2f66c3 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:00.759892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-089af355-c74d-4fde-adc2-48013e2f66c3 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:00.769905 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-089af355-c74d-4fde-adc2-48013e2f66c3 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.237874 Apr 14 16:15:00.770719 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 339/687] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:00 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:01.156358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6f57289c-8c28-4bd3-b830-4f45e0f62af3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:01.157147 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6f57289c-8c28-4bd3-b830-4f45e0f62af3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:01.165681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f57289c-8c28-4bd3-b830-4f45e0f62af3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:01.166427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f57289c-8c28-4bd3-b830-4f45e0f62af3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:01.168165 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f57289c-8c28-4bd3-b830-4f45e0f62af3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:01.168644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f57289c-8c28-4bd3-b830-4f45e0f62af3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:01.633418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6f57289c-8c28-4bd3-b830-4f45e0f62af3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:01.648658 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6f57289c-8c28-4bd3-b830-4f45e0f62af3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:01.650937 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6f57289c-8c28-4bd3-b830-4f45e0f62af3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:01.652622 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6f57289c-8c28-4bd3-b830-4f45e0f62af3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.500570 Apr 14 16:15:01.653535 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 349/688] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:15:01 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:15:01.789636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-84ae33f3-ba35-459c-b8c3-02287f90b2dd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:01.790523 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-84ae33f3-ba35-459c-b8c3-02287f90b2dd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:01.799443 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84ae33f3-ba35-459c-b8c3-02287f90b2dd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:01.800248 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84ae33f3-ba35-459c-b8c3-02287f90b2dd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:01.801264 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84ae33f3-ba35-459c-b8c3-02287f90b2dd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:01.801848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-84ae33f3-ba35-459c-b8c3-02287f90b2dd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:02.050193 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-84ae33f3-ba35-459c-b8c3-02287f90b2dd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:02.062061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-84ae33f3-ba35-459c-b8c3-02287f90b2dd tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.276681 Apr 14 16:15:02.062876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 340/689] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:01 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:02.674114 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6b51ae48-a190-405a-b926-032a0c981d17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:02.675258 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6b51ae48-a190-405a-b926-032a0c981d17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:02.686083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b51ae48-a190-405a-b926-032a0c981d17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:02.686828 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b51ae48-a190-405a-b926-032a0c981d17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:02.687740 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b51ae48-a190-405a-b926-032a0c981d17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:02.688484 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b51ae48-a190-405a-b926-032a0c981d17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:02.830779 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-018bf4a8-77a6-4e7f-a9eb-ccfbe3fbd67f req-fd4860ce-71ae-4025-947d-5f8afaea0d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e83f61-2715-436f-8d7c-88c4483cc0e5", "name": "network-vif-plugged", "status": "completed", "tag": "d74de9c1-8188-4d05-92fc-6cdce0aa2e31"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:02.833069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:15:02.833069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:15:02.843513 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-018bf4a8-77a6-4e7f-a9eb-ccfbe3fbd67f req-fd4860ce-71ae-4025-947d-5f8afaea0d4f service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:02.844207 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-018bf4a8-77a6-4e7f-a9eb-ccfbe3fbd67f req-fd4860ce-71ae-4025-947d-5f8afaea0d4f service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:02.871234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-018bf4a8-77a6-4e7f-a9eb-ccfbe3fbd67f req-fd4860ce-71ae-4025-947d-5f8afaea0d4f service nova] Creating event network-vif-plugged:d74de9c1-8188-4d05-92fc-6cdce0aa2e31 for instance 97e83f61-2715-436f-8d7c-88c4483cc0e5 on hv-cinder-78626 Apr 14 16:15:02.877146 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-018bf4a8-77a6-4e7f-a9eb-ccfbe3fbd67f req-fd4860ce-71ae-4025-947d-5f8afaea0d4f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050732 Apr 14 16:15:02.877991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 341/690] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:15:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:15:03.083232 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-dc6fa659-2fda-4519-99cc-6b5c0c81c795 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:03.085795 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-dc6fa659-2fda-4519-99cc-6b5c0c81c795 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:03.096447 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc6fa659-2fda-4519-99cc-6b5c0c81c795 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:03.106013 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc6fa659-2fda-4519-99cc-6b5c0c81c795 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:03.107196 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc6fa659-2fda-4519-99cc-6b5c0c81c795 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:03.107920 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dc6fa659-2fda-4519-99cc-6b5c0c81c795 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:03.182752 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6b51ae48-a190-405a-b926-032a0c981d17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:03.196937 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6b51ae48-a190-405a-b926-032a0c981d17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:03.198669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6b51ae48-a190-405a-b926-032a0c981d17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:03.199904 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6b51ae48-a190-405a-b926-032a0c981d17 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.530911 Apr 14 16:15:03.200720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 350/691] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:15:02 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:15:03.388214 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-dc6fa659-2fda-4519-99cc-6b5c0c81c795 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:03.399692 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-dc6fa659-2fda-4519-99cc-6b5c0c81c795 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.322441 Apr 14 16:15:03.401292 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 342/692] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:03 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:03.859761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-d8353d04-394c-41f8-a713-0bfdbb7008e8 req-8a210583-c926-4e8a-b36d-a4ba867c34a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bca69cc6-ca35-4146-8a19-b3e35097b152", "tag": "795f1499-91ff-4e4d-8ef8-0d1a0241293e"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:03.859761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:15:03.859761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:15:03.868711 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-d8353d04-394c-41f8-a713-0bfdbb7008e8 req-8a210583-c926-4e8a-b36d-a4ba867c34a3 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:03.869281 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-d8353d04-394c-41f8-a713-0bfdbb7008e8 req-8a210583-c926-4e8a-b36d-a4ba867c34a3 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:03.887353 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-d8353d04-394c-41f8-a713-0bfdbb7008e8 req-8a210583-c926-4e8a-b36d-a4ba867c34a3 service nova] Creating event network-changed:795f1499-91ff-4e4d-8ef8-0d1a0241293e for instance bca69cc6-ca35-4146-8a19-b3e35097b152 on hv-cinder-78626 Apr 14 16:15:03.892575 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-d8353d04-394c-41f8-a713-0bfdbb7008e8 req-8a210583-c926-4e8a-b36d-a4ba867c34a3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040060 Apr 14 16:15:03.893303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 351/693] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:15:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:15:04.223000 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9478b6ba-e946-46cf-92b0-0c4fe3859819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:04.223682 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9478b6ba-e946-46cf-92b0-0c4fe3859819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:04.233633 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9478b6ba-e946-46cf-92b0-0c4fe3859819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:04.234354 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9478b6ba-e946-46cf-92b0-0c4fe3859819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:04.235587 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9478b6ba-e946-46cf-92b0-0c4fe3859819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:04.236241 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9478b6ba-e946-46cf-92b0-0c4fe3859819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:04.383439 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a62db077-22ea-48e5-ae9f-5115b43e8bbd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:04.383881 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a62db077-22ea-48e5-ae9f-5115b43e8bbd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:04.395297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a62db077-22ea-48e5-ae9f-5115b43e8bbd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:04.395964 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a62db077-22ea-48e5-ae9f-5115b43e8bbd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:04.396824 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a62db077-22ea-48e5-ae9f-5115b43e8bbd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:04.397347 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a62db077-22ea-48e5-ae9f-5115b43e8bbd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:04.510661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a62db077-22ea-48e5-ae9f-5115b43e8bbd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Going to try to terminate instance {{(pid=99334) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:15:04.513430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9478b6ba-e946-46cf-92b0-0c4fe3859819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:04.526268 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9478b6ba-e946-46cf-92b0-0c4fe3859819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:04.528349 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9478b6ba-e946-46cf-92b0-0c4fe3859819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:04.529767 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9478b6ba-e946-46cf-92b0-0c4fe3859819 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.311013 Apr 14 16:15:04.530488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 343/694] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:15:04 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:15:04.536265 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-50ff4e6c-7026-47cf-b4f9-be64d2d0eccf tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:04.537194 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-50ff4e6c-7026-47cf-b4f9-be64d2d0eccf tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:04.547526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-50ff4e6c-7026-47cf-b4f9-be64d2d0eccf tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:04.548349 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-50ff4e6c-7026-47cf-b4f9-be64d2d0eccf tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:04.549714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-50ff4e6c-7026-47cf-b4f9-be64d2d0eccf tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:04.550417 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-50ff4e6c-7026-47cf-b4f9-be64d2d0eccf tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:04.647706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a62db077-22ea-48e5-ae9f-5115b43e8bbd tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 204 len: 0 microversion: 2.1 time: 0.268890 Apr 14 16:15:04.648665 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 352/695] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:15:04 2021] DELETE /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 14 16:15:04.660079 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-372128a7-424e-4882-b353-6a5642edc4ea tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:04.661077 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-372128a7-424e-4882-b353-6a5642edc4ea tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:04.671206 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-372128a7-424e-4882-b353-6a5642edc4ea tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:04.671727 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-372128a7-424e-4882-b353-6a5642edc4ea tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:04.672524 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-372128a7-424e-4882-b353-6a5642edc4ea tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:04.673008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-372128a7-424e-4882-b353-6a5642edc4ea tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:04.790634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-50ff4e6c-7026-47cf-b4f9-be64d2d0eccf tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:04.799321 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-50ff4e6c-7026-47cf-b4f9-be64d2d0eccf tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.267520 Apr 14 16:15:04.800280 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 344/696] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:04 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:05.363685 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-372128a7-424e-4882-b353-6a5642edc4ea tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:05.378107 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-372128a7-424e-4882-b353-6a5642edc4ea tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1507 microversion: 2.1 time: 0.723451 Apr 14 16:15:05.388936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 353/697] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:04 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1507 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:05.549552 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-486c5a6e-ec83-45bc-8324-4f6b1303fbce tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:05.550568 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-486c5a6e-ec83-45bc-8324-4f6b1303fbce tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:05.559205 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-486c5a6e-ec83-45bc-8324-4f6b1303fbce tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:05.559970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-486c5a6e-ec83-45bc-8324-4f6b1303fbce tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:05.561292 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-486c5a6e-ec83-45bc-8324-4f6b1303fbce tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:05.562083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-486c5a6e-ec83-45bc-8324-4f6b1303fbce tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:05.823278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-486c5a6e-ec83-45bc-8324-4f6b1303fbce tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:05.830079 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4613b3d8-5f2c-40e7-8b60-2c39384fc6ae tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:05.833970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4613b3d8-5f2c-40e7-8b60-2c39384fc6ae tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:05.834893 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-486c5a6e-ec83-45bc-8324-4f6b1303fbce tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:05.836706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-486c5a6e-ec83-45bc-8324-4f6b1303fbce tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:05.838063 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-486c5a6e-ec83-45bc-8324-4f6b1303fbce tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1809 microversion: 2.20 time: 0.292539 Apr 14 16:15:05.851629 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 345/698] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:15:05 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1809 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:15:05.862095 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4613b3d8-5f2c-40e7-8b60-2c39384fc6ae tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:05.862965 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4613b3d8-5f2c-40e7-8b60-2c39384fc6ae tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:05.864361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4613b3d8-5f2c-40e7-8b60-2c39384fc6ae tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:05.864865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4613b3d8-5f2c-40e7-8b60-2c39384fc6ae tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:06.134177 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4613b3d8-5f2c-40e7-8b60-2c39384fc6ae tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:06.145502 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4613b3d8-5f2c-40e7-8b60-2c39384fc6ae tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.331900 Apr 14 16:15:06.146138 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 354/699] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:05 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:06.397662 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4de80381-35ab-415b-9d4e-a6bd64e3ae26 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:06.398231 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4de80381-35ab-415b-9d4e-a6bd64e3ae26 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:06.406738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4de80381-35ab-415b-9d4e-a6bd64e3ae26 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:06.407157 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4de80381-35ab-415b-9d4e-a6bd64e3ae26 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:06.407991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4de80381-35ab-415b-9d4e-a6bd64e3ae26 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:06.408741 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4de80381-35ab-415b-9d4e-a6bd64e3ae26 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:06.613500 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4de80381-35ab-415b-9d4e-a6bd64e3ae26 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:06.623626 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4de80381-35ab-415b-9d4e-a6bd64e3ae26 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1507 microversion: 2.1 time: 0.230304 Apr 14 16:15:06.624246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 346/700] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:06 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:06.860480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3981d3a6-eb0d-4336-a8ff-27c4fe69cabf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:06.861366 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3981d3a6-eb0d-4336-a8ff-27c4fe69cabf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:06.869171 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3981d3a6-eb0d-4336-a8ff-27c4fe69cabf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:06.869684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3981d3a6-eb0d-4336-a8ff-27c4fe69cabf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:06.870515 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3981d3a6-eb0d-4336-a8ff-27c4fe69cabf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:06.871043 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3981d3a6-eb0d-4336-a8ff-27c4fe69cabf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:07.151921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3981d3a6-eb0d-4336-a8ff-27c4fe69cabf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:07.162433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3981d3a6-eb0d-4336-a8ff-27c4fe69cabf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:07.164091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3981d3a6-eb0d-4336-a8ff-27c4fe69cabf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:07.164253 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-791339f9-55b1-4ce2-92e5-dcee565d6267 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:07.164912 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-791339f9-55b1-4ce2-92e5-dcee565d6267 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:07.165722 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3981d3a6-eb0d-4336-a8ff-27c4fe69cabf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1796 microversion: 2.20 time: 0.309959 Apr 14 16:15:07.166973 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 355/701] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:15:06 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1796 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:15:07.173667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-791339f9-55b1-4ce2-92e5-dcee565d6267 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:07.174406 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-791339f9-55b1-4ce2-92e5-dcee565d6267 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:07.175263 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-791339f9-55b1-4ce2-92e5-dcee565d6267 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:07.175765 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-791339f9-55b1-4ce2-92e5-dcee565d6267 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:07.385467 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-791339f9-55b1-4ce2-92e5-dcee565d6267 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:07.394834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-791339f9-55b1-4ce2-92e5-dcee565d6267 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.234675 Apr 14 16:15:07.395473 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 347/702] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:07 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:07.641715 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f4bcaadc-d168-4604-afac-920cefe3f364 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:07.642380 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f4bcaadc-d168-4604-afac-920cefe3f364 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:07.650242 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f4bcaadc-d168-4604-afac-920cefe3f364 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:07.651330 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f4bcaadc-d168-4604-afac-920cefe3f364 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:07.652394 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f4bcaadc-d168-4604-afac-920cefe3f364 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:07.652893 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f4bcaadc-d168-4604-afac-920cefe3f364 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:07.860468 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f4bcaadc-d168-4604-afac-920cefe3f364 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:07.879859 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f4bcaadc-d168-4604-afac-920cefe3f364 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1507 microversion: 2.1 time: 0.231812 Apr 14 16:15:07.879859 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 356/703] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:07 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:08.414293 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-32813fbd-24d8-4b56-b00b-f56bb6991da0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:08.414896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-32813fbd-24d8-4b56-b00b-f56bb6991da0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:08.422735 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-32813fbd-24d8-4b56-b00b-f56bb6991da0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:08.423490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-32813fbd-24d8-4b56-b00b-f56bb6991da0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:08.424378 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-32813fbd-24d8-4b56-b00b-f56bb6991da0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:08.424871 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-32813fbd-24d8-4b56-b00b-f56bb6991da0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:08.634361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-32813fbd-24d8-4b56-b00b-f56bb6991da0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:08.644575 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-32813fbd-24d8-4b56-b00b-f56bb6991da0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.234499 Apr 14 16:15:08.645296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 348/704] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:08 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:08.888689 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ccb941c4-cf1a-4cb1-b33f-194b53844a52 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:08.889380 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ccb941c4-cf1a-4cb1-b33f-194b53844a52 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:08.897370 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccb941c4-cf1a-4cb1-b33f-194b53844a52 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:08.897878 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccb941c4-cf1a-4cb1-b33f-194b53844a52 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:08.898716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccb941c4-cf1a-4cb1-b33f-194b53844a52 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:08.899205 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccb941c4-cf1a-4cb1-b33f-194b53844a52 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:09.103413 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ccb941c4-cf1a-4cb1-b33f-194b53844a52 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:09.118024 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ccb941c4-cf1a-4cb1-b33f-194b53844a52 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1507 microversion: 2.1 time: 0.233922 Apr 14 16:15:09.118696 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 357/705] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:08 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:09.664152 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bd0822e5-c09d-42be-b0f4-9b5c76660e5d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:09.665509 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bd0822e5-c09d-42be-b0f4-9b5c76660e5d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:09.674093 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd0822e5-c09d-42be-b0f4-9b5c76660e5d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:09.674611 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd0822e5-c09d-42be-b0f4-9b5c76660e5d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:09.675479 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd0822e5-c09d-42be-b0f4-9b5c76660e5d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:09.675980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd0822e5-c09d-42be-b0f4-9b5c76660e5d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:09.880276 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bd0822e5-c09d-42be-b0f4-9b5c76660e5d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:09.890949 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bd0822e5-c09d-42be-b0f4-9b5c76660e5d tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.230923 Apr 14 16:15:09.891570 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 349/706] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:09 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:10.136390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b4e18645-caba-47a5-a0b9-5851914438df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:10.136982 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b4e18645-caba-47a5-a0b9-5851914438df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:10.145967 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b4e18645-caba-47a5-a0b9-5851914438df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:10.146468 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b4e18645-caba-47a5-a0b9-5851914438df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:10.147307 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b4e18645-caba-47a5-a0b9-5851914438df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:10.147788 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b4e18645-caba-47a5-a0b9-5851914438df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:10.205689 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-ea302f0a-be61-4d4d-84f9-a142e6452110 req-ba95753a-28cc-4a3f-8c9b-3a0b73139c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab89b0d-d22c-4d99-8946-878629b4a370", "name": "network-vif-deleted", "tag": "d0063e5f-fce6-4c5b-9155-46be8709096a"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:10.207763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:15:10.207763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:15:10.217464 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-ea302f0a-be61-4d4d-84f9-a142e6452110 req-ba95753a-28cc-4a3f-8c9b-3a0b73139c9a service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:10.217969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-ea302f0a-be61-4d4d-84f9-a142e6452110 req-ba95753a-28cc-4a3f-8c9b-3a0b73139c9a service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:10.237578 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-ea302f0a-be61-4d4d-84f9-a142e6452110 req-ba95753a-28cc-4a3f-8c9b-3a0b73139c9a service nova] Creating event network-vif-deleted:d0063e5f-fce6-4c5b-9155-46be8709096a for instance dab89b0d-d22c-4d99-8946-878629b4a370 on hv-cinder-78626 Apr 14 16:15:10.243882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-ea302f0a-be61-4d4d-84f9-a142e6452110 req-ba95753a-28cc-4a3f-8c9b-3a0b73139c9a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042201 Apr 14 16:15:10.245230 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 350/707] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:15:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:15:10.306215 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b4e18645-caba-47a5-a0b9-5851914438df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:10.315862 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b4e18645-caba-47a5-a0b9-5851914438df tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 200 len: 1465 microversion: 2.1 time: 0.183728 Apr 14 16:15:10.316495 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 358/708] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:10 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 1465 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:10.912797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0ab647af-d76f-4d6f-afda-325fd5e02d9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:10.914054 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0ab647af-d76f-4d6f-afda-325fd5e02d9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:10.924948 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0ab647af-d76f-4d6f-afda-325fd5e02d9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:10.925495 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0ab647af-d76f-4d6f-afda-325fd5e02d9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:10.926364 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0ab647af-d76f-4d6f-afda-325fd5e02d9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:10.926866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0ab647af-d76f-4d6f-afda-325fd5e02d9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:11.142155 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0ab647af-d76f-4d6f-afda-325fd5e02d9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:11.152867 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0ab647af-d76f-4d6f-afda-325fd5e02d9e tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.245039 Apr 14 16:15:11.153567 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 351/709] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:10 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:11.334228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-25e2c762-d632-4dc1-a742-c5cc3b5a9cee tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:11.334887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-25e2c762-d632-4dc1-a742-c5cc3b5a9cee tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: dab89b0d-d22c-4d99-8946-878629b4a370] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:11.343187 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25e2c762-d632-4dc1-a742-c5cc3b5a9cee tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:11.343686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25e2c762-d632-4dc1-a742-c5cc3b5a9cee tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:11.344505 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25e2c762-d632-4dc1-a742-c5cc3b5a9cee tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:11.344992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25e2c762-d632-4dc1-a742-c5cc3b5a9cee tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:11.400832 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-25e2c762-d632-4dc1-a742-c5cc3b5a9cee tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] HTTP exception thrown: Instance dab89b0d-d22c-4d99-8946-878629b4a370 could not be found. Apr 14 16:15:11.401725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-25e2c762-d632-4dc1-a742-c5cc3b5a9cee tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Returning 404 to user: Instance dab89b0d-d22c-4d99-8946-878629b4a370 could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:15:11.402543 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-25e2c762-d632-4dc1-a742-c5cc3b5a9cee tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370" status: 404 len: 111 microversion: 2.1 time: 0.072427 Apr 14 16:15:11.403425 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 359/710] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:11 2021] GET /compute/v2.1/servers/dab89b0d-d22c-4d99-8946-878629b4a370 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:15:11.412092 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-50448f14-bc86-4453-bc88-e48a8641a8db tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:11.412651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-50448f14-bc86-4453-bc88-e48a8641a8db tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:11.421413 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-50448f14-bc86-4453-bc88-e48a8641a8db tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:11.421930 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-50448f14-bc86-4453-bc88-e48a8641a8db tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:11.422772 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-50448f14-bc86-4453-bc88-e48a8641a8db tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:11.423265 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-50448f14-bc86-4453-bc88-e48a8641a8db tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:11.488452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-50448f14-bc86-4453-bc88-e48a8641a8db tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Going to try to terminate instance {{(pid=99335) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:15:11.605535 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-50448f14-bc86-4453-bc88-e48a8641a8db tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 204 len: 0 microversion: 2.1 time: 0.197357 Apr 14 16:15:11.606554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 352/711] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:15:11 2021] DELETE /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:15:11.615234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b8d20fae-599b-4a0f-99a6-31a564e0204b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:11.615958 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b8d20fae-599b-4a0f-99a6-31a564e0204b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:11.624685 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8d20fae-599b-4a0f-99a6-31a564e0204b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:11.625225 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8d20fae-599b-4a0f-99a6-31a564e0204b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:11.626114 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8d20fae-599b-4a0f-99a6-31a564e0204b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:11.626602 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8d20fae-599b-4a0f-99a6-31a564e0204b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:11.822702 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b8d20fae-599b-4a0f-99a6-31a564e0204b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:11.833419 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b8d20fae-599b-4a0f-99a6-31a564e0204b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.222088 Apr 14 16:15:11.834180 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 360/712] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:11 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:12.172913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4017d82b-fc08-45ca-8e28-33d003f86ed0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:12.173714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4017d82b-fc08-45ca-8e28-33d003f86ed0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:12.183694 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4017d82b-fc08-45ca-8e28-33d003f86ed0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:12.184197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4017d82b-fc08-45ca-8e28-33d003f86ed0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:12.185085 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4017d82b-fc08-45ca-8e28-33d003f86ed0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:12.185585 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4017d82b-fc08-45ca-8e28-33d003f86ed0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:12.383601 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4017d82b-fc08-45ca-8e28-33d003f86ed0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:12.393105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4017d82b-fc08-45ca-8e28-33d003f86ed0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1756 microversion: 2.1 time: 0.224679 Apr 14 16:15:12.393653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 353/713] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:12 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1756 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:12.852431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-10746e0c-4aa4-4103-a4a8-0d70da549082 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:12.852979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-10746e0c-4aa4-4103-a4a8-0d70da549082 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:12.860877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10746e0c-4aa4-4103-a4a8-0d70da549082 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:12.861404 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10746e0c-4aa4-4103-a4a8-0d70da549082 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:12.862232 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10746e0c-4aa4-4103-a4a8-0d70da549082 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:12.862717 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10746e0c-4aa4-4103-a4a8-0d70da549082 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:13.066853 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-10746e0c-4aa4-4103-a4a8-0d70da549082 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:13.075889 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-10746e0c-4aa4-4103-a4a8-0d70da549082 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.227648 Apr 14 16:15:13.076520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 361/714] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:12 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:13.411798 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8f052478-047e-474b-bbf2-e9fd585d98b1 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:13.412385 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8f052478-047e-474b-bbf2-e9fd585d98b1 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:13.420992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f052478-047e-474b-bbf2-e9fd585d98b1 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:13.421545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f052478-047e-474b-bbf2-e9fd585d98b1 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:13.422369 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f052478-047e-474b-bbf2-e9fd585d98b1 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:13.422860 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f052478-047e-474b-bbf2-e9fd585d98b1 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:13.765338 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8f052478-047e-474b-bbf2-e9fd585d98b1 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:13.774939 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8f052478-047e-474b-bbf2-e9fd585d98b1 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1759 microversion: 2.1 time: 0.367448 Apr 14 16:15:13.776349 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 354/715] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:13 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1759 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:14.095390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c06ad165-da6c-49db-b605-6262659e6d7f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:14.096111 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c06ad165-da6c-49db-b605-6262659e6d7f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:14.105451 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c06ad165-da6c-49db-b605-6262659e6d7f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:14.106340 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c06ad165-da6c-49db-b605-6262659e6d7f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:14.106896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c06ad165-da6c-49db-b605-6262659e6d7f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:14.107388 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c06ad165-da6c-49db-b605-6262659e6d7f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:14.317690 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c06ad165-da6c-49db-b605-6262659e6d7f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:14.327123 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c06ad165-da6c-49db-b605-6262659e6d7f tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.235804 Apr 14 16:15:14.327755 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 362/716] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:14 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:15.345341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9f7ba7a3-a4d9-429b-92db-5c56378e41e2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:15.346008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9f7ba7a3-a4d9-429b-92db-5c56378e41e2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:15.354919 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9f7ba7a3-a4d9-429b-92db-5c56378e41e2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:15.355434 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9f7ba7a3-a4d9-429b-92db-5c56378e41e2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:15.356290 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9f7ba7a3-a4d9-429b-92db-5c56378e41e2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:15.356783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9f7ba7a3-a4d9-429b-92db-5c56378e41e2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:15.553872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9f7ba7a3-a4d9-429b-92db-5c56378e41e2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:15.563943 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9f7ba7a3-a4d9-429b-92db-5c56378e41e2 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.222761 Apr 14 16:15:15.564566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 355/717] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:15 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:16.582585 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f30e4f7b-49ce-492e-a551-393dc6f2c821 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:16.583105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f30e4f7b-49ce-492e-a551-393dc6f2c821 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:16.592135 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f30e4f7b-49ce-492e-a551-393dc6f2c821 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:16.592633 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f30e4f7b-49ce-492e-a551-393dc6f2c821 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:16.593517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f30e4f7b-49ce-492e-a551-393dc6f2c821 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:16.594003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f30e4f7b-49ce-492e-a551-393dc6f2c821 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:16.793208 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f30e4f7b-49ce-492e-a551-393dc6f2c821 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:16.802268 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f30e4f7b-49ce-492e-a551-393dc6f2c821 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.223939 Apr 14 16:15:16.802896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 363/718] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:16 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:17.820950 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8f2e41e7-8b0c-42c4-ab72-7531d4d66e6b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:17.822194 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8f2e41e7-8b0c-42c4-ab72-7531d4d66e6b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:17.834991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f2e41e7-8b0c-42c4-ab72-7531d4d66e6b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:17.835498 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f2e41e7-8b0c-42c4-ab72-7531d4d66e6b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:17.836507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f2e41e7-8b0c-42c4-ab72-7531d4d66e6b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:17.837444 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f2e41e7-8b0c-42c4-ab72-7531d4d66e6b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:18.074348 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8f2e41e7-8b0c-42c4-ab72-7531d4d66e6b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:18.085481 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8f2e41e7-8b0c-42c4-ab72-7531d4d66e6b tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.269047 Apr 14 16:15:18.086139 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 356/719] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:17 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:19.104753 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-515d3c5e-2115-465b-9854-0bb4aaa2f2c5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:19.105475 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-515d3c5e-2115-465b-9854-0bb4aaa2f2c5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:19.113503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-515d3c5e-2115-465b-9854-0bb4aaa2f2c5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:19.114008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-515d3c5e-2115-465b-9854-0bb4aaa2f2c5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:19.114848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-515d3c5e-2115-465b-9854-0bb4aaa2f2c5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:19.115339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-515d3c5e-2115-465b-9854-0bb4aaa2f2c5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:19.321675 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-515d3c5e-2115-465b-9854-0bb4aaa2f2c5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:19.330946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-515d3c5e-2115-465b-9854-0bb4aaa2f2c5 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.230897 Apr 14 16:15:19.331567 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 364/720] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:19 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:20.349734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d843b222-fc2c-4c42-abfd-6db41f33fab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:20.350411 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d843b222-fc2c-4c42-abfd-6db41f33fab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:20.358843 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d843b222-fc2c-4c42-abfd-6db41f33fab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:20.359355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d843b222-fc2c-4c42-abfd-6db41f33fab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:20.360192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d843b222-fc2c-4c42-abfd-6db41f33fab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:20.360690 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d843b222-fc2c-4c42-abfd-6db41f33fab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:20.557468 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d843b222-fc2c-4c42-abfd-6db41f33fab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:20.569010 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d843b222-fc2c-4c42-abfd-6db41f33fab0 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.223058 Apr 14 16:15:20.569776 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 357/721] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:20 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:21.589013 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fa8d5fc2-c851-428a-98eb-fa1a18e22a94 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:21.589761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fa8d5fc2-c851-428a-98eb-fa1a18e22a94 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:21.597675 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fa8d5fc2-c851-428a-98eb-fa1a18e22a94 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:21.598177 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fa8d5fc2-c851-428a-98eb-fa1a18e22a94 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:21.599017 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fa8d5fc2-c851-428a-98eb-fa1a18e22a94 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:21.599498 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fa8d5fc2-c851-428a-98eb-fa1a18e22a94 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:21.996085 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fa8d5fc2-c851-428a-98eb-fa1a18e22a94 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:22.005408 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fa8d5fc2-c851-428a-98eb-fa1a18e22a94 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1520 microversion: 2.1 time: 0.421134 Apr 14 16:15:22.006053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 365/722] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:21 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:22.300597 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-8d9ac8e1-d4ea-40a7-a8e5-d2ec8bb498fc req-0a3d5702-18cc-4cd0-8cde-e60abeda9a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a704e48-ff08-4961-9c93-7a0fdf04543d", "name": "network-vif-deleted", "tag": "56a60b7b-6e5f-46c0-9f81-4dffc4926337"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:22.302443 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:15:22.302443 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:15:22.311769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-8d9ac8e1-d4ea-40a7-a8e5-d2ec8bb498fc req-0a3d5702-18cc-4cd0-8cde-e60abeda9a3f service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:22.312271 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-8d9ac8e1-d4ea-40a7-a8e5-d2ec8bb498fc req-0a3d5702-18cc-4cd0-8cde-e60abeda9a3f service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:22.330439 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-8d9ac8e1-d4ea-40a7-a8e5-d2ec8bb498fc req-0a3d5702-18cc-4cd0-8cde-e60abeda9a3f service nova] Creating event network-vif-deleted:56a60b7b-6e5f-46c0-9f81-4dffc4926337 for instance 0a704e48-ff08-4961-9c93-7a0fdf04543d on hv-cinder-78626 Apr 14 16:15:22.335541 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-8d9ac8e1-d4ea-40a7-a8e5-d2ec8bb498fc req-0a3d5702-18cc-4cd0-8cde-e60abeda9a3f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038960 Apr 14 16:15:22.336234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 358/723] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:15:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:15:23.024031 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4fe1d8b1-17dc-432a-a252-d7e40de88a87 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:23.024693 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4fe1d8b1-17dc-432a-a252-d7e40de88a87 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:23.033230 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4fe1d8b1-17dc-432a-a252-d7e40de88a87 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:23.033737 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4fe1d8b1-17dc-432a-a252-d7e40de88a87 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:23.034574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4fe1d8b1-17dc-432a-a252-d7e40de88a87 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:23.035066 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4fe1d8b1-17dc-432a-a252-d7e40de88a87 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:23.114677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4fe1d8b1-17dc-432a-a252-d7e40de88a87 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:23.115179 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4fe1d8b1-17dc-432a-a252-d7e40de88a87 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:23.115684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-4fe1d8b1-17dc-432a-a252-d7e40de88a87 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lazy-loading 'fault' on Instance uuid 0a704e48-ff08-4961-9c93-7a0fdf04543d {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:15:23.200892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4fe1d8b1-17dc-432a-a252-d7e40de88a87 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530f5df43ffe47f68faced876280447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0238a8f524a30a94d06aa25d272f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:23.211908 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4fe1d8b1-17dc-432a-a252-d7e40de88a87 tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 200 len: 1312 microversion: 2.1 time: 0.191820 Apr 14 16:15:23.213105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 366/724] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:23 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 1312 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:24.231882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9fc06bed-d947-47c2-accf-d049589f52aa tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:24.232633 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9fc06bed-d947-47c2-accf-d049589f52aa tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] [instance: 0a704e48-ff08-4961-9c93-7a0fdf04543d] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:24.240782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9fc06bed-d947-47c2-accf-d049589f52aa tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:24.241296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9fc06bed-d947-47c2-accf-d049589f52aa tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:24.242131 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9fc06bed-d947-47c2-accf-d049589f52aa tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:24.242801 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9fc06bed-d947-47c2-accf-d049589f52aa tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:24.297446 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-9fc06bed-d947-47c2-accf-d049589f52aa tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] HTTP exception thrown: Instance 0a704e48-ff08-4961-9c93-7a0fdf04543d could not be found. Apr 14 16:15:24.298113 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9fc06bed-d947-47c2-accf-d049589f52aa tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] Returning 404 to user: Instance 0a704e48-ff08-4961-9c93-7a0fdf04543d could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:15:24.299027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9fc06bed-d947-47c2-accf-d049589f52aa tempest-ServerRescueNegativeTestJSON-103953813 tempest-ServerRescueNegativeTestJSON-103953813-project] 10.222.0.60 "GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d" status: 404 len: 111 microversion: 2.1 time: 0.072046 Apr 14 16:15:24.299647 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 359/725] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:24 2021] GET /compute/v2.1/servers/0a704e48-ff08-4961-9c93-7a0fdf04543d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:15:32.522585 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-71966286-6500-46e4-ab25-bd04b2f98465 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:32.523102 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-71966286-6500-46e4-ab25-bd04b2f98465 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:32.531167 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-71966286-6500-46e4-ab25-bd04b2f98465 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:32.531675 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-71966286-6500-46e4-ab25-bd04b2f98465 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:32.532517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-71966286-6500-46e4-ab25-bd04b2f98465 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:32.533303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-71966286-6500-46e4-ab25-bd04b2f98465 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:32.709029 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-71966286-6500-46e4-ab25-bd04b2f98465 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lazy-loading 'services' on Instance uuid 0dd8ae4b-9ee1-4ba9-830e-d1e721901938 {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:15:32.857590 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-71966286-6500-46e4-ab25-bd04b2f98465 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/os-volume_attachments/ecf2c572-09d3-4ca9-bacb-d45b2cdea9e7" status: 202 len: 0 microversion: 2.1 time: 0.338865 Apr 14 16:15:32.858235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 367/726] 10.222.0.60 () {58 vars in 1406 bytes} [Wed Apr 14 16:15:32 2021] DELETE /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/os-volume_attachments/ecf2c572-09d3-4ca9-bacb-d45b2cdea9e7 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:15:35.268555 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c5063bca-3cf4-4fd5-a330-e07e73296330 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:35.277169 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5063bca-3cf4-4fd5-a330-e07e73296330 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:35.277703 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5063bca-3cf4-4fd5-a330-e07e73296330 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:35.336255 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c5063bca-3cf4-4fd5-a330-e07e73296330 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Going to try to stop instance {{(pid=99335) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 14 16:15:35.421397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c5063bca-3cf4-4fd5-a330-e07e73296330 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 202 len: 0 microversion: 2.1 time: 0.156470 Apr 14 16:15:35.422079 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 360/727] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:15:35 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:15:35.431519 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-12bfbc37-50b5-4c9a-947f-3dc446ea2d1c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:35.432442 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-12bfbc37-50b5-4c9a-947f-3dc446ea2d1c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:35.441342 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-12bfbc37-50b5-4c9a-947f-3dc446ea2d1c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:35.441916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-12bfbc37-50b5-4c9a-947f-3dc446ea2d1c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:35.442886 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-12bfbc37-50b5-4c9a-947f-3dc446ea2d1c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:35.443370 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-12bfbc37-50b5-4c9a-947f-3dc446ea2d1c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:35.650875 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-12bfbc37-50b5-4c9a-947f-3dc446ea2d1c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:35.660142 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-12bfbc37-50b5-4c9a-947f-3dc446ea2d1c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.233162 Apr 14 16:15:35.660858 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 368/728] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:35 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:36.679778 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-406ca588-4aa4-4956-9028-649d8c90c705 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:36.680640 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-406ca588-4aa4-4956-9028-649d8c90c705 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:36.689055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-406ca588-4aa4-4956-9028-649d8c90c705 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:36.689764 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-406ca588-4aa4-4956-9028-649d8c90c705 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:36.690670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-406ca588-4aa4-4956-9028-649d8c90c705 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:36.691159 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-406ca588-4aa4-4956-9028-649d8c90c705 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:37.100532 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-406ca588-4aa4-4956-9028-649d8c90c705 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:37.110996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-406ca588-4aa4-4956-9028-649d8c90c705 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.435717 Apr 14 16:15:37.111885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 361/729] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:36 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:38.130007 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d6b5743c-eb8a-4aee-a62d-725a3d28d35d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:38.130639 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d6b5743c-eb8a-4aee-a62d-725a3d28d35d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:38.139165 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d6b5743c-eb8a-4aee-a62d-725a3d28d35d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:38.139680 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d6b5743c-eb8a-4aee-a62d-725a3d28d35d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:38.140902 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d6b5743c-eb8a-4aee-a62d-725a3d28d35d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:38.141430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d6b5743c-eb8a-4aee-a62d-725a3d28d35d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:38.521585 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d6b5743c-eb8a-4aee-a62d-725a3d28d35d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:38.531427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d6b5743c-eb8a-4aee-a62d-725a3d28d35d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.405576 Apr 14 16:15:38.532061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 369/730] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:38 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:39.182776 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1000501741", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:39.251920 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] validate_networks() for None {{(pid=99335) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:15:39.528948 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Flavor limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:15:39.529473 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Image limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:15:39.530016 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Flavor pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:15:39.530480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Image pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:15:39.530947 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:15:39.540091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:39.541161 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:39.542038 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:39.542556 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:39.550065 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d7c6c655-7fc1-4339-ac34-a43a24ee53d3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:39.550729 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d7c6c655-7fc1-4339-ac34-a43a24ee53d3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:39.559586 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d7c6c655-7fc1-4339-ac34-a43a24ee53d3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:39.560100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d7c6c655-7fc1-4339-ac34-a43a24ee53d3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:39.560935 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d7c6c655-7fc1-4339-ac34-a43a24ee53d3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:39.561452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d7c6c655-7fc1-4339-ac34-a43a24ee53d3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:39.561710 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Getting quotas for project 7e33f7dfcfe547edad9f7f9d374576f4. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:15:39.566241 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Getting quotas for user b7aee2abc3794391b782f46365c98ce0 and project 7e33f7dfcfe547edad9f7f9d374576f4. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:15:39.577814 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Going to run 1 instances... {{(pid=99335) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:15:39.580425 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:15:39.630768 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1f684280-1f13-44a2-b397-383ae1532a41 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.452463 Apr 14 16:15:39.631635 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 362/731] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:15:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:15:39.650636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-19759795-6cdf-4139-8890-586514a3ca1f tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:39.651321 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-19759795-6cdf-4139-8890-586514a3ca1f tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:39.733402 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-19759795-6cdf-4139-8890-586514a3ca1f tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:39.743597 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-19759795-6cdf-4139-8890-586514a3ca1f tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1215 microversion: 2.1 time: 0.098518 Apr 14 16:15:39.744680 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 363/732] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:39 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:40.050777 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d7c6c655-7fc1-4339-ac34-a43a24ee53d3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:40.061425 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d7c6c655-7fc1-4339-ac34-a43a24ee53d3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.515107 Apr 14 16:15:40.062774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 370/733] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:39 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:40.762903 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-70259167-101b-4209-a5f8-944647fb4577 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:40.763581 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-70259167-101b-4209-a5f8-944647fb4577 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:40.771531 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70259167-101b-4209-a5f8-944647fb4577 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:40.772049 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70259167-101b-4209-a5f8-944647fb4577 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:40.772894 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70259167-101b-4209-a5f8-944647fb4577 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:40.773425 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70259167-101b-4209-a5f8-944647fb4577 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:40.902120 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-70259167-101b-4209-a5f8-944647fb4577 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:40.911201 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-70259167-101b-4209-a5f8-944647fb4577 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1267 microversion: 2.1 time: 0.152928 Apr 14 16:15:40.911836 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 364/734] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:40 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:41.080512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b2d3d527-a206-48db-9600-8a37c7aa9257 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:41.081372 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b2d3d527-a206-48db-9600-8a37c7aa9257 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:41.090570 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b2d3d527-a206-48db-9600-8a37c7aa9257 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:41.091382 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b2d3d527-a206-48db-9600-8a37c7aa9257 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:41.092501 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b2d3d527-a206-48db-9600-8a37c7aa9257 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:41.093998 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b2d3d527-a206-48db-9600-8a37c7aa9257 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:41.461242 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b2d3d527-a206-48db-9600-8a37c7aa9257 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:41.470797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b2d3d527-a206-48db-9600-8a37c7aa9257 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.394662 Apr 14 16:15:41.471433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 371/735] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:41 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:41.931248 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f1b4cbaa-942f-4ee0-973c-f43cccf5b6b7 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:41.932096 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f1b4cbaa-942f-4ee0-973c-f43cccf5b6b7 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:41.940303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1b4cbaa-942f-4ee0-973c-f43cccf5b6b7 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:41.940854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1b4cbaa-942f-4ee0-973c-f43cccf5b6b7 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:41.941787 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1b4cbaa-942f-4ee0-973c-f43cccf5b6b7 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:41.943159 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1b4cbaa-942f-4ee0-973c-f43cccf5b6b7 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:42.072847 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f1b4cbaa-942f-4ee0-973c-f43cccf5b6b7 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:42.081653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f1b4cbaa-942f-4ee0-973c-f43cccf5b6b7 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1273 microversion: 2.1 time: 0.155079 Apr 14 16:15:42.082288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 365/736] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:41 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:42.490617 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b099cf0e-df6e-4d50-967d-f0d0b1539fba tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:42.491283 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b099cf0e-df6e-4d50-967d-f0d0b1539fba tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:42.499574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b099cf0e-df6e-4d50-967d-f0d0b1539fba tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:42.500076 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b099cf0e-df6e-4d50-967d-f0d0b1539fba tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:42.500950 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b099cf0e-df6e-4d50-967d-f0d0b1539fba tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:42.501473 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b099cf0e-df6e-4d50-967d-f0d0b1539fba tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:42.866947 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b099cf0e-df6e-4d50-967d-f0d0b1539fba tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:42.876741 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b099cf0e-df6e-4d50-967d-f0d0b1539fba tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.390161 Apr 14 16:15:42.877446 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 372/737] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:42 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:43.107475 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-06cb9dc7-98b9-47a1-964f-7a8b51ec74aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:43.108812 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-06cb9dc7-98b9-47a1-964f-7a8b51ec74aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:43.145969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06cb9dc7-98b9-47a1-964f-7a8b51ec74aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:43.147982 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06cb9dc7-98b9-47a1-964f-7a8b51ec74aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:43.148851 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06cb9dc7-98b9-47a1-964f-7a8b51ec74aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:43.149580 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06cb9dc7-98b9-47a1-964f-7a8b51ec74aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:43.400978 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-06cb9dc7-98b9-47a1-964f-7a8b51ec74aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:43.411092 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-06cb9dc7-98b9-47a1-964f-7a8b51ec74aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1315 microversion: 2.1 time: 0.315055 Apr 14 16:15:43.412020 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 366/738] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:43 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:43.850520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-1049ed83-1c0f-456b-a4dc-bf4f67ae872b req-b645c557-ac80-4bc2-a286-22e22dfdfbaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49750900-d280-4567-b84a-3940e2d09f5f", "tag": "dc33b260-4117-444d-b158-7c45668d26c2"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:43.854224 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:15:43.854224 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:15:43.864376 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-1049ed83-1c0f-456b-a4dc-bf4f67ae872b req-b645c557-ac80-4bc2-a286-22e22dfdfbaf service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:43.864886 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-1049ed83-1c0f-456b-a4dc-bf4f67ae872b req-b645c557-ac80-4bc2-a286-22e22dfdfbaf service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:43.885507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-1049ed83-1c0f-456b-a4dc-bf4f67ae872b req-b645c557-ac80-4bc2-a286-22e22dfdfbaf service nova] Creating event network-changed:dc33b260-4117-444d-b158-7c45668d26c2 for instance 49750900-d280-4567-b84a-3940e2d09f5f on hv-cinder-78626 Apr 14 16:15:43.890608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-1049ed83-1c0f-456b-a4dc-bf4f67ae872b req-b645c557-ac80-4bc2-a286-22e22dfdfbaf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044291 Apr 14 16:15:43.891493 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 373/739] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:15:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:15:43.895754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-40d3c508-d4a9-442e-8944-008fa1d4344e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:43.896444 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-40d3c508-d4a9-442e-8944-008fa1d4344e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:43.904894 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40d3c508-d4a9-442e-8944-008fa1d4344e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:43.905561 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40d3c508-d4a9-442e-8944-008fa1d4344e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:43.906420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40d3c508-d4a9-442e-8944-008fa1d4344e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:43.906921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40d3c508-d4a9-442e-8944-008fa1d4344e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:44.120732 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-40d3c508-d4a9-442e-8944-008fa1d4344e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:44.130911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-40d3c508-d4a9-442e-8944-008fa1d4344e tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.239183 Apr 14 16:15:44.131830 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 367/740] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:43 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:44.431268 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-65cf5dcc-ba6b-4739-8bd8-31fde589f4aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:44.432521 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-65cf5dcc-ba6b-4739-8bd8-31fde589f4aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:44.443525 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-65cf5dcc-ba6b-4739-8bd8-31fde589f4aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:44.444035 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-65cf5dcc-ba6b-4739-8bd8-31fde589f4aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:44.444896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-65cf5dcc-ba6b-4739-8bd8-31fde589f4aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:44.445465 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-65cf5dcc-ba6b-4739-8bd8-31fde589f4aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:45.036674 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-65cf5dcc-ba6b-4739-8bd8-31fde589f4aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:45.046285 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-65cf5dcc-ba6b-4739-8bd8-31fde589f4aa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1315 microversion: 2.1 time: 0.620456 Apr 14 16:15:45.047336 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 374/741] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:44 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:45.150121 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5a443fa8-46e7-465d-97d9-4337007e2b6b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:45.150942 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5a443fa8-46e7-465d-97d9-4337007e2b6b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:45.159605 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a443fa8-46e7-465d-97d9-4337007e2b6b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:45.160211 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a443fa8-46e7-465d-97d9-4337007e2b6b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:45.161071 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a443fa8-46e7-465d-97d9-4337007e2b6b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:45.161589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a443fa8-46e7-465d-97d9-4337007e2b6b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:45.358810 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5a443fa8-46e7-465d-97d9-4337007e2b6b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:45.367610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5a443fa8-46e7-465d-97d9-4337007e2b6b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.221524 Apr 14 16:15:45.369135 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 368/742] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:45 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:46.065343 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-419659b6-bcb0-4a7e-b0fa-a08c2d9b588a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:46.066013 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-419659b6-bcb0-4a7e-b0fa-a08c2d9b588a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:46.074042 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-419659b6-bcb0-4a7e-b0fa-a08c2d9b588a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:46.074558 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-419659b6-bcb0-4a7e-b0fa-a08c2d9b588a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:46.075394 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-419659b6-bcb0-4a7e-b0fa-a08c2d9b588a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:46.075889 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-419659b6-bcb0-4a7e-b0fa-a08c2d9b588a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:46.279892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-419659b6-bcb0-4a7e-b0fa-a08c2d9b588a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:46.289077 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-419659b6-bcb0-4a7e-b0fa-a08c2d9b588a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1315 microversion: 2.1 time: 0.227835 Apr 14 16:15:46.289724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 375/743] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:46 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:46.387288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1a60d350-004b-4015-896e-7d638101e757 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:46.387968 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1a60d350-004b-4015-896e-7d638101e757 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:46.395803 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1a60d350-004b-4015-896e-7d638101e757 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:46.396316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1a60d350-004b-4015-896e-7d638101e757 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:46.397180 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1a60d350-004b-4015-896e-7d638101e757 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:46.397681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1a60d350-004b-4015-896e-7d638101e757 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:46.614104 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1a60d350-004b-4015-896e-7d638101e757 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:46.623838 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1a60d350-004b-4015-896e-7d638101e757 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.241165 Apr 14 16:15:46.624684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 369/744] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:46 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:47.307459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1d2e03a5-5f26-475a-9293-8cca75c99b49 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:47.308124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1d2e03a5-5f26-475a-9293-8cca75c99b49 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:47.316670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d2e03a5-5f26-475a-9293-8cca75c99b49 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:47.317216 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d2e03a5-5f26-475a-9293-8cca75c99b49 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:47.318040 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d2e03a5-5f26-475a-9293-8cca75c99b49 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:47.318662 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d2e03a5-5f26-475a-9293-8cca75c99b49 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:47.512876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1d2e03a5-5f26-475a-9293-8cca75c99b49 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:47.522655 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1d2e03a5-5f26-475a-9293-8cca75c99b49 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1315 microversion: 2.1 time: 0.219556 Apr 14 16:15:47.523305 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 376/745] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:47 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:47.642627 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-eab7409c-c213-47e5-bbc3-e5f0f21edf19 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:47.643340 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-eab7409c-c213-47e5-bbc3-e5f0f21edf19 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:47.651872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eab7409c-c213-47e5-bbc3-e5f0f21edf19 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:47.652376 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eab7409c-c213-47e5-bbc3-e5f0f21edf19 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:47.653267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eab7409c-c213-47e5-bbc3-e5f0f21edf19 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:47.653760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eab7409c-c213-47e5-bbc3-e5f0f21edf19 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:47.855723 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-eab7409c-c213-47e5-bbc3-e5f0f21edf19 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:47.867767 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-eab7409c-c213-47e5-bbc3-e5f0f21edf19 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.229190 Apr 14 16:15:47.868997 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 370/746] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:47 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:48.542103 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-20059b44-8c5d-4d85-83f3-44973736652a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:48.542696 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-20059b44-8c5d-4d85-83f3-44973736652a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:48.550653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20059b44-8c5d-4d85-83f3-44973736652a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:48.551150 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20059b44-8c5d-4d85-83f3-44973736652a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:48.551977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20059b44-8c5d-4d85-83f3-44973736652a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:48.552463 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20059b44-8c5d-4d85-83f3-44973736652a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:48.755173 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-20059b44-8c5d-4d85-83f3-44973736652a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:48.764516 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-20059b44-8c5d-4d85-83f3-44973736652a tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1315 microversion: 2.1 time: 0.226541 Apr 14 16:15:48.765158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 377/747] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:48 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:48.886684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ba83b4d6-3608-4738-b847-b0b16f829311 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:48.887355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ba83b4d6-3608-4738-b847-b0b16f829311 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:48.895371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ba83b4d6-3608-4738-b847-b0b16f829311 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:48.895876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ba83b4d6-3608-4738-b847-b0b16f829311 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:48.896711 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ba83b4d6-3608-4738-b847-b0b16f829311 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:48.897249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ba83b4d6-3608-4738-b847-b0b16f829311 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:49.315987 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ba83b4d6-3608-4738-b847-b0b16f829311 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:49.325598 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ba83b4d6-3608-4738-b847-b0b16f829311 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.442974 Apr 14 16:15:49.326188 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 371/748] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:48 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:49.783756 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f6f36c02-7f82-4757-abe7-5a7eeaa3df91 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:49.784472 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f6f36c02-7f82-4757-abe7-5a7eeaa3df91 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:49.792714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f6f36c02-7f82-4757-abe7-5a7eeaa3df91 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:49.793257 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f6f36c02-7f82-4757-abe7-5a7eeaa3df91 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:49.794101 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f6f36c02-7f82-4757-abe7-5a7eeaa3df91 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:49.794598 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f6f36c02-7f82-4757-abe7-5a7eeaa3df91 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:49.986828 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f6f36c02-7f82-4757-abe7-5a7eeaa3df91 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:49.995628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f6f36c02-7f82-4757-abe7-5a7eeaa3df91 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1315 microversion: 2.1 time: 0.216163 Apr 14 16:15:49.996255 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 378/749] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:49 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:50.322635 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:15:50.322870 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: Wed Apr 14 16:15:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 14 16:15:50.343619 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-67e5144e-1a32-4fa9-91f7-8025c8877230 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:50.344291 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-67e5144e-1a32-4fa9-91f7-8025c8877230 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:50.352208 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-67e5144e-1a32-4fa9-91f7-8025c8877230 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:50.353126 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-67e5144e-1a32-4fa9-91f7-8025c8877230 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:50.353955 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-67e5144e-1a32-4fa9-91f7-8025c8877230 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:50.354452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-67e5144e-1a32-4fa9-91f7-8025c8877230 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:50.553794 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-67e5144e-1a32-4fa9-91f7-8025c8877230 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:50.564905 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-67e5144e-1a32-4fa9-91f7-8025c8877230 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.225092 Apr 14 16:15:50.565561 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 372/750] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:50 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:51.014966 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-27b3bc58-3d6b-460d-8af9-7e01829f29fa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:51.015616 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-27b3bc58-3d6b-460d-8af9-7e01829f29fa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:51.024981 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-27b3bc58-3d6b-460d-8af9-7e01829f29fa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:51.025936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-27b3bc58-3d6b-460d-8af9-7e01829f29fa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:51.026582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-27b3bc58-3d6b-460d-8af9-7e01829f29fa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:51.027076 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-27b3bc58-3d6b-460d-8af9-7e01829f29fa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:51.221471 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-7201107e-74f4-41ab-9341-7a1a3bf4962e req-33b7fb8e-1234-4dc5-95db-773cd83357da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49750900-d280-4567-b84a-3940e2d09f5f", "name": "network-vif-plugged", "status": "completed", "tag": "dc33b260-4117-444d-b158-7c45668d26c2"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:51.223511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:15:51.223511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:15:51.234154 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-7201107e-74f4-41ab-9341-7a1a3bf4962e req-33b7fb8e-1234-4dc5-95db-773cd83357da service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:51.234595 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-7201107e-74f4-41ab-9341-7a1a3bf4962e req-33b7fb8e-1234-4dc5-95db-773cd83357da service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:51.252440 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-7201107e-74f4-41ab-9341-7a1a3bf4962e req-33b7fb8e-1234-4dc5-95db-773cd83357da service nova] Creating event network-vif-plugged:dc33b260-4117-444d-b158-7c45668d26c2 for instance 49750900-d280-4567-b84a-3940e2d09f5f on hv-cinder-78626 Apr 14 16:15:51.255042 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-27b3bc58-3d6b-460d-8af9-7e01829f29fa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:51.257678 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-7201107e-74f4-41ab-9341-7a1a3bf4962e req-33b7fb8e-1234-4dc5-95db-773cd83357da service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040484 Apr 14 16:15:51.258358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 373/751] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:15:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:15:51.265448 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-27b3bc58-3d6b-460d-8af9-7e01829f29fa tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1315 microversion: 2.1 time: 0.254962 Apr 14 16:15:51.266289 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 379/752] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:51 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:51.584072 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b2818ef1-4276-4bac-b52c-93ece12eb9d4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:51.584848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b2818ef1-4276-4bac-b52c-93ece12eb9d4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:51.594363 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b2818ef1-4276-4bac-b52c-93ece12eb9d4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:51.594873 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b2818ef1-4276-4bac-b52c-93ece12eb9d4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:51.595712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b2818ef1-4276-4bac-b52c-93ece12eb9d4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:51.596208 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b2818ef1-4276-4bac-b52c-93ece12eb9d4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:51.801554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b2818ef1-4276-4bac-b52c-93ece12eb9d4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:51.812188 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b2818ef1-4276-4bac-b52c-93ece12eb9d4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.232585 Apr 14 16:15:51.812824 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 374/753] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:51 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:52.284307 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e87a6099-346f-4ef1-b3da-d160eb07d965 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:52.285433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e87a6099-346f-4ef1-b3da-d160eb07d965 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:52.294080 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e87a6099-346f-4ef1-b3da-d160eb07d965 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:52.294588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e87a6099-346f-4ef1-b3da-d160eb07d965 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:52.295469 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e87a6099-346f-4ef1-b3da-d160eb07d965 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:52.295955 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e87a6099-346f-4ef1-b3da-d160eb07d965 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:52.629316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e87a6099-346f-4ef1-b3da-d160eb07d965 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:52.639219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e87a6099-346f-4ef1-b3da-d160eb07d965 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1315 microversion: 2.1 time: 0.359233 Apr 14 16:15:52.650536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 380/754] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:52 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:52.830821 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4c13bc15-49a0-4cba-8839-55672faf915d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:52.831711 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4c13bc15-49a0-4cba-8839-55672faf915d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:52.839868 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4c13bc15-49a0-4cba-8839-55672faf915d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:52.840488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4c13bc15-49a0-4cba-8839-55672faf915d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:52.841587 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4c13bc15-49a0-4cba-8839-55672faf915d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:52.842167 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4c13bc15-49a0-4cba-8839-55672faf915d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:53.053794 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4c13bc15-49a0-4cba-8839-55672faf915d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:53.065494 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4c13bc15-49a0-4cba-8839-55672faf915d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.237351 Apr 14 16:15:53.066400 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 375/755] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:52 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:53.658256 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a84d304d-fe92-41f7-a519-aea9a4024504 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:53.658917 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a84d304d-fe92-41f7-a519-aea9a4024504 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:53.667474 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a84d304d-fe92-41f7-a519-aea9a4024504 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:53.667924 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a84d304d-fe92-41f7-a519-aea9a4024504 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:53.668813 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a84d304d-fe92-41f7-a519-aea9a4024504 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:53.669333 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a84d304d-fe92-41f7-a519-aea9a4024504 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:53.949535 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a84d304d-fe92-41f7-a519-aea9a4024504 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:53.958456 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a84d304d-fe92-41f7-a519-aea9a4024504 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1464 microversion: 2.1 time: 0.304457 Apr 14 16:15:53.959143 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 381/756] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:53 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1464 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:54.035721 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-20cb939f-b7e6-4ea7-a157-a780c9905f1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:54.036355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-20cb939f-b7e6-4ea7-a157-a780c9905f1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:54.046602 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20cb939f-b7e6-4ea7-a157-a780c9905f1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:54.047266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20cb939f-b7e6-4ea7-a157-a780c9905f1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:54.048267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20cb939f-b7e6-4ea7-a157-a780c9905f1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:54.048900 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20cb939f-b7e6-4ea7-a157-a780c9905f1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:54.084244 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fd4aa39d-c0c3-42bd-b550-14a4c599c999 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:54.084927 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fd4aa39d-c0c3-42bd-b550-14a4c599c999 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:54.093886 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fd4aa39d-c0c3-42bd-b550-14a4c599c999 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:54.094405 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fd4aa39d-c0c3-42bd-b550-14a4c599c999 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:54.095259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fd4aa39d-c0c3-42bd-b550-14a4c599c999 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:54.095754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fd4aa39d-c0c3-42bd-b550-14a4c599c999 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:54.117119 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-20cb939f-b7e6-4ea7-a157-a780c9905f1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Going to try to terminate instance {{(pid=99335) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:15:54.255993 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-20cb939f-b7e6-4ea7-a157-a780c9905f1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "DELETE /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 204 len: 0 microversion: 2.1 time: 0.225611 Apr 14 16:15:54.257082 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 376/757] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:15:54 2021] DELETE /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:15:54.267283 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-716c6744-f272-46b3-883e-4aa949dac68c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:54.268501 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-716c6744-f272-46b3-883e-4aa949dac68c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:54.278211 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-716c6744-f272-46b3-883e-4aa949dac68c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:54.278813 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-716c6744-f272-46b3-883e-4aa949dac68c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:54.279941 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-716c6744-f272-46b3-883e-4aa949dac68c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:54.280683 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-716c6744-f272-46b3-883e-4aa949dac68c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:54.333835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fd4aa39d-c0c3-42bd-b550-14a4c599c999 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:54.353665 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fd4aa39d-c0c3-42bd-b550-14a4c599c999 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.273328 Apr 14 16:15:54.354793 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 382/758] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:54 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:54.492725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-716c6744-f272-46b3-883e-4aa949dac68c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:54.502409 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-716c6744-f272-46b3-883e-4aa949dac68c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1470 microversion: 2.1 time: 0.240916 Apr 14 16:15:54.503068 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 377/759] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:54 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1470 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:55.372436 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-11b1da50-6539-4855-a148-771c4752c88f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:55.373174 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-11b1da50-6539-4855-a148-771c4752c88f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:55.381125 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11b1da50-6539-4855-a148-771c4752c88f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:55.381608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11b1da50-6539-4855-a148-771c4752c88f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:55.382451 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11b1da50-6539-4855-a148-771c4752c88f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:55.382944 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11b1da50-6539-4855-a148-771c4752c88f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:55.523115 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4cb5b586-cb9d-4f80-943e-f57eea7385af tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:55.524133 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4cb5b586-cb9d-4f80-943e-f57eea7385af tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:55.532977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4cb5b586-cb9d-4f80-943e-f57eea7385af tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:55.534074 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4cb5b586-cb9d-4f80-943e-f57eea7385af tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:55.535017 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4cb5b586-cb9d-4f80-943e-f57eea7385af tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:55.535591 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4cb5b586-cb9d-4f80-943e-f57eea7385af tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:55.586074 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-11b1da50-6539-4855-a148-771c4752c88f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:55.595718 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-11b1da50-6539-4855-a148-771c4752c88f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1675 microversion: 2.1 time: 0.227925 Apr 14 16:15:55.596338 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 383/760] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:55 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1675 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:55.743548 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4cb5b586-cb9d-4f80-943e-f57eea7385af tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:55.752539 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4cb5b586-cb9d-4f80-943e-f57eea7385af tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1470 microversion: 2.1 time: 0.234412 Apr 14 16:15:55.753190 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 378/761] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:55 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1470 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:15:56.614404 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-11c960f1-bb1b-425a-bb93-ede55f6ffad7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:56.615053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-11c960f1-bb1b-425a-bb93-ede55f6ffad7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:56.623433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11c960f1-bb1b-425a-bb93-ede55f6ffad7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:56.623944 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11c960f1-bb1b-425a-bb93-ede55f6ffad7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:56.624848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11c960f1-bb1b-425a-bb93-ede55f6ffad7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:56.625360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-11c960f1-bb1b-425a-bb93-ede55f6ffad7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:56.770923 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-459cbd7c-42b8-4c5b-9171-bbcdbe951e1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:56.771583 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-459cbd7c-42b8-4c5b-9171-bbcdbe951e1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:56.780299 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-459cbd7c-42b8-4c5b-9171-bbcdbe951e1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:56.780814 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-459cbd7c-42b8-4c5b-9171-bbcdbe951e1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:56.781670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-459cbd7c-42b8-4c5b-9171-bbcdbe951e1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:56.782360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-459cbd7c-42b8-4c5b-9171-bbcdbe951e1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:56.987936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-459cbd7c-42b8-4c5b-9171-bbcdbe951e1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:56.998151 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-459cbd7c-42b8-4c5b-9171-bbcdbe951e1c tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1470 microversion: 2.1 time: 0.231171 Apr 14 16:15:56.999172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 379/762] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:56 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1470 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:57.020173 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-11c960f1-bb1b-425a-bb93-ede55f6ffad7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:57.029367 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-11c960f1-bb1b-425a-bb93-ede55f6ffad7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1652 microversion: 2.1 time: 0.418934 Apr 14 16:15:57.030090 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 384/763] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:56 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1652 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:57.048593 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3164fa01-39dd-4ce3-859c-cb5428f922c3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:57.057350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3164fa01-39dd-4ce3-859c-cb5428f922c3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:57.057964 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3164fa01-39dd-4ce3-859c-cb5428f922c3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:57.128095 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3164fa01-39dd-4ce3-859c-cb5428f922c3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Going to try to start instance {{(pid=99335) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 14 16:15:57.208683 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3164fa01-39dd-4ce3-859c-cb5428f922c3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action" status: 202 len: 0 microversion: 2.1 time: 0.163906 Apr 14 16:15:57.209559 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 380/764] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:15:57 2021] POST /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:15:57.218201 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c5a89550-bece-4bdf-a369-a9ea5f0779ee tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:57.218876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c5a89550-bece-4bdf-a369-a9ea5f0779ee tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:57.226778 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5a89550-bece-4bdf-a369-a9ea5f0779ee tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:57.227362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5a89550-bece-4bdf-a369-a9ea5f0779ee tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:57.228358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5a89550-bece-4bdf-a369-a9ea5f0779ee tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:57.228854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5a89550-bece-4bdf-a369-a9ea5f0779ee tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:58.018761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-36a63c88-33bf-436d-80ac-9a8b27fff087 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:58.019800 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-36a63c88-33bf-436d-80ac-9a8b27fff087 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:58.028366 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-36a63c88-33bf-436d-80ac-9a8b27fff087 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:58.028886 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-36a63c88-33bf-436d-80ac-9a8b27fff087 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:58.029980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-36a63c88-33bf-436d-80ac-9a8b27fff087 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:58.030489 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-36a63c88-33bf-436d-80ac-9a8b27fff087 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:58.055147 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c5a89550-bece-4bdf-a369-a9ea5f0779ee tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:58.068269 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c5a89550-bece-4bdf-a369-a9ea5f0779ee tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1661 microversion: 2.1 time: 0.854097 Apr 14 16:15:58.070670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 385/765] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:57 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1661 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:58.254292 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-36a63c88-33bf-436d-80ac-9a8b27fff087 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:58.275021 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-36a63c88-33bf-436d-80ac-9a8b27fff087 tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1428 microversion: 2.1 time: 0.260540 Apr 14 16:15:58.276530 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 381/766] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:58 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1428 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:58.452552 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-cfa230a0-eb69-48c3-a970-18e7e6fa8a31 req-63fcbf1a-7635-4419-8e37-50bff84fb7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49750900-d280-4567-b84a-3940e2d09f5f", "name": "network-vif-deleted", "tag": "dc33b260-4117-444d-b158-7c45668d26c2"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:58.454623 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:15:58.454623 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:15:58.467651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-cfa230a0-eb69-48c3-a970-18e7e6fa8a31 req-63fcbf1a-7635-4419-8e37-50bff84fb7fb service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:58.468549 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-cfa230a0-eb69-48c3-a970-18e7e6fa8a31 req-63fcbf1a-7635-4419-8e37-50bff84fb7fb service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:58.497380 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-cfa230a0-eb69-48c3-a970-18e7e6fa8a31 req-63fcbf1a-7635-4419-8e37-50bff84fb7fb service nova] Creating event network-vif-deleted:dc33b260-4117-444d-b158-7c45668d26c2 for instance 49750900-d280-4567-b84a-3940e2d09f5f on hv-cinder-78626 Apr 14 16:15:58.502757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-cfa230a0-eb69-48c3-a970-18e7e6fa8a31 req-63fcbf1a-7635-4419-8e37-50bff84fb7fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055191 Apr 14 16:15:58.503344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 386/767] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:15:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:15:59.088679 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1c4331da-f960-4d9d-b0e3-db5bff2e413b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:59.089957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1c4331da-f960-4d9d-b0e3-db5bff2e413b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:59.098285 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1c4331da-f960-4d9d-b0e3-db5bff2e413b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:59.098791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1c4331da-f960-4d9d-b0e3-db5bff2e413b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:59.099633 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1c4331da-f960-4d9d-b0e3-db5bff2e413b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:59.100125 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1c4331da-f960-4d9d-b0e3-db5bff2e413b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:59.295140 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a45cf7e7-a5b8-4cf5-b981-a22822ab76dc tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:15:59.296262 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a45cf7e7-a5b8-4cf5-b981-a22822ab76dc tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:15:59.308288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a45cf7e7-a5b8-4cf5-b981-a22822ab76dc tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:59.309064 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a45cf7e7-a5b8-4cf5-b981-a22822ab76dc tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:59.309916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a45cf7e7-a5b8-4cf5-b981-a22822ab76dc tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:59.310564 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a45cf7e7-a5b8-4cf5-b981-a22822ab76dc tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:59.379155 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1c4331da-f960-4d9d-b0e3-db5bff2e413b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:59.390972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1c4331da-f960-4d9d-b0e3-db5bff2e413b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1661 microversion: 2.1 time: 0.306422 Apr 14 16:15:59.399788 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 382/768] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:59 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1661 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:59.412252 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a45cf7e7-a5b8-4cf5-b981-a22822ab76dc tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:15:59.412847 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a45cf7e7-a5b8-4cf5-b981-a22822ab76dc tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:15:59.413418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-a45cf7e7-a5b8-4cf5-b981-a22822ab76dc tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lazy-loading 'fault' on Instance uuid 49750900-d280-4567-b84a-3940e2d09f5f {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:15:59.498112 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a45cf7e7-a5b8-4cf5-b981-a22822ab76dc tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aee2abc3794391b782f46365c98ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e33f7dfcfe547edad9f7f9d374576f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:15:59.506631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a45cf7e7-a5b8-4cf5-b981-a22822ab76dc tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 200 len: 1305 microversion: 2.1 time: 0.216860 Apr 14 16:15:59.507267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 387/769] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:15:59 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 1305 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:00.410694 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c64d9c68-a113-4cb1-9a14-0b51cd96cbd2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:00.411938 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c64d9c68-a113-4cb1-9a14-0b51cd96cbd2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:00.420410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c64d9c68-a113-4cb1-9a14-0b51cd96cbd2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:00.420928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c64d9c68-a113-4cb1-9a14-0b51cd96cbd2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:00.421808 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c64d9c68-a113-4cb1-9a14-0b51cd96cbd2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:00.422298 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c64d9c68-a113-4cb1-9a14-0b51cd96cbd2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:00.526105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fb8ecc15-8773-412a-a54d-761bdbf844ea tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:00.526986 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fb8ecc15-8773-412a-a54d-761bdbf844ea tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] [instance: 49750900-d280-4567-b84a-3940e2d09f5f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:00.537970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb8ecc15-8773-412a-a54d-761bdbf844ea tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:00.538480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb8ecc15-8773-412a-a54d-761bdbf844ea tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:00.539335 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb8ecc15-8773-412a-a54d-761bdbf844ea tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:00.540573 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb8ecc15-8773-412a-a54d-761bdbf844ea tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:00.599884 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-fb8ecc15-8773-412a-a54d-761bdbf844ea tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] HTTP exception thrown: Instance 49750900-d280-4567-b84a-3940e2d09f5f could not be found. Apr 14 16:16:00.600563 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fb8ecc15-8773-412a-a54d-761bdbf844ea tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] Returning 404 to user: Instance 49750900-d280-4567-b84a-3940e2d09f5f could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:16:00.601506 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fb8ecc15-8773-412a-a54d-761bdbf844ea tempest-VolumesNegativeTest-1693997752 tempest-VolumesNegativeTest-1693997752-project] 10.222.0.60 "GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f" status: 404 len: 111 microversion: 2.1 time: 0.079769 Apr 14 16:16:00.602954 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 388/770] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:00 2021] GET /compute/v2.1/servers/49750900-d280-4567-b84a-3940e2d09f5f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:16:00.631392 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c64d9c68-a113-4cb1-9a14-0b51cd96cbd2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:00.640856 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c64d9c68-a113-4cb1-9a14-0b51cd96cbd2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1665 microversion: 2.1 time: 0.234424 Apr 14 16:16:00.641738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 383/771] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:00 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1665 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:12.718420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-103bc3dc-6a50-4138-9db1-1a16eb43d976 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:12.719108 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-103bc3dc-6a50-4138-9db1-1a16eb43d976 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:12.728521 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-103bc3dc-6a50-4138-9db1-1a16eb43d976 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:12.728838 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-103bc3dc-6a50-4138-9db1-1a16eb43d976 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:12.729726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-103bc3dc-6a50-4138-9db1-1a16eb43d976 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:12.730220 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-103bc3dc-6a50-4138-9db1-1a16eb43d976 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:12.806671 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-103bc3dc-6a50-4138-9db1-1a16eb43d976 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/os-volume_attachments/23590de3-9668-479b-8bdd-1418c4a17a08" status: 200 len: 194 microversion: 2.20 time: 0.289732 Apr 14 16:16:12.807314 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 389/772] 10.222.0.60 () {60 vars in 1444 bytes} [Wed Apr 14 16:16:12 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/os-volume_attachments/23590de3-9668-479b-8bdd-1418c4a17a08 => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:16:12.930481 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7320a700-04e6-42e8-97c3-d2d36f8a4a3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:12.931320 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7320a700-04e6-42e8-97c3-d2d36f8a4a3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:12.939214 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7320a700-04e6-42e8-97c3-d2d36f8a4a3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:12.939729 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7320a700-04e6-42e8-97c3-d2d36f8a4a3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:12.940584 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7320a700-04e6-42e8-97c3-d2d36f8a4a3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:12.941103 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7320a700-04e6-42e8-97c3-d2d36f8a4a3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:13.114612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-7320a700-04e6-42e8-97c3-d2d36f8a4a3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lazy-loading 'services' on Instance uuid 97e83f61-2715-436f-8d7c-88c4483cc0e5 {{(pid=99335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:16:13.263459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7320a700-04e6-42e8-97c3-d2d36f8a4a3e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "DELETE /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/os-volume_attachments/23590de3-9668-479b-8bdd-1418c4a17a08" status: 202 len: 0 microversion: 2.20 time: 0.337484 Apr 14 16:16:13.264045 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 384/773] 10.222.0.60 () {60 vars in 1447 bytes} [Wed Apr 14 16:16:12 2021] DELETE /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5/os-volume_attachments/23590de3-9668-479b-8bdd-1418c4a17a08 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:16:15.591940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-06cf67db-af0c-4f80-97a7-255b411de680 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:15.591940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-06cf67db-af0c-4f80-97a7-255b411de680 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:15.607656 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06cf67db-af0c-4f80-97a7-255b411de680 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:15.614971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06cf67db-af0c-4f80-97a7-255b411de680 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:15.616011 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06cf67db-af0c-4f80-97a7-255b411de680 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:15.616481 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06cf67db-af0c-4f80-97a7-255b411de680 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:15.687578 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-06cf67db-af0c-4f80-97a7-255b411de680 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Going to try to terminate instance {{(pid=99334) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:16:15.806503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-06cf67db-af0c-4f80-97a7-255b411de680 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "DELETE /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 204 len: 0 microversion: 2.20 time: 0.219723 Apr 14 16:16:15.807458 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 390/774] 10.222.0.60 () {60 vars in 1270 bytes} [Wed Apr 14 16:16:15 2021] DELETE /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 16:16:15.817653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1e8fb83f-1cfa-4dc3-bddf-60be05e4884b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:15.819012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1e8fb83f-1cfa-4dc3-bddf-60be05e4884b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:15.828108 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e8fb83f-1cfa-4dc3-bddf-60be05e4884b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:15.828612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e8fb83f-1cfa-4dc3-bddf-60be05e4884b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:15.829526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e8fb83f-1cfa-4dc3-bddf-60be05e4884b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:15.830016 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e8fb83f-1cfa-4dc3-bddf-60be05e4884b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:16.205928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1e8fb83f-1cfa-4dc3-bddf-60be05e4884b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:16.216697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1e8fb83f-1cfa-4dc3-bddf-60be05e4884b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:16.218537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1e8fb83f-1cfa-4dc3-bddf-60be05e4884b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:16.219853 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1e8fb83f-1cfa-4dc3-bddf-60be05e4884b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.407631 Apr 14 16:16:16.220555 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 385/775] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:15 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:17.241841 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5e9dd198-5fab-442a-829c-40f00b0949ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:17.242612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5e9dd198-5fab-442a-829c-40f00b0949ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:17.250418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e9dd198-5fab-442a-829c-40f00b0949ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:17.250933 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e9dd198-5fab-442a-829c-40f00b0949ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:17.251780 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e9dd198-5fab-442a-829c-40f00b0949ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:17.252275 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e9dd198-5fab-442a-829c-40f00b0949ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:17.456418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5e9dd198-5fab-442a-829c-40f00b0949ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:17.466775 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5e9dd198-5fab-442a-829c-40f00b0949ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:17.468459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5e9dd198-5fab-442a-829c-40f00b0949ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:17.469822 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5e9dd198-5fab-442a-829c-40f00b0949ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.232737 Apr 14 16:16:17.470443 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 391/776] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:17 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:18.489977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d132729d-ac1a-429e-8221-caebf847f7ae tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:18.490806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d132729d-ac1a-429e-8221-caebf847f7ae tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:18.499121 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d132729d-ac1a-429e-8221-caebf847f7ae tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:18.499758 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d132729d-ac1a-429e-8221-caebf847f7ae tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:18.500675 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d132729d-ac1a-429e-8221-caebf847f7ae tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:18.501362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d132729d-ac1a-429e-8221-caebf847f7ae tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:18.869380 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d132729d-ac1a-429e-8221-caebf847f7ae tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:18.879702 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d132729d-ac1a-429e-8221-caebf847f7ae tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:18.881544 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d132729d-ac1a-429e-8221-caebf847f7ae tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:18.882779 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d132729d-ac1a-429e-8221-caebf847f7ae tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1724 microversion: 2.20 time: 0.396941 Apr 14 16:16:18.883382 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 386/777] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:18 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1724 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:19.129807 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6b0f0387-0032-4b2f-b11c-4bb8880b2e82 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-307888182"}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:19.130868 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6b0f0387-0032-4b2f-b11c-4bb8880b2e82 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:19.141263 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b0f0387-0032-4b2f-b11c-4bb8880b2e82 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:19.142185 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b0f0387-0032-4b2f-b11c-4bb8880b2e82 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:19.143192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b0f0387-0032-4b2f-b11c-4bb8880b2e82 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:19.144217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b0f0387-0032-4b2f-b11c-4bb8880b2e82 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:19.358715 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.network.security_group_api [None req-6b0f0387-0032-4b2f-b11c-4bb8880b2e82 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Removing security group e471750e-8a1e-40c7-af46-00e29ce14023 from port 3a58c362-2e99-4559-9977-3b635ab88161 Apr 14 16:16:19.905735 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cd812579-f095-49d1-87ac-7f938036d361 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:19.907472 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cd812579-f095-49d1-87ac-7f938036d361 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:19.916379 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd812579-f095-49d1-87ac-7f938036d361 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:19.917239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd812579-f095-49d1-87ac-7f938036d361 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:19.918474 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd812579-f095-49d1-87ac-7f938036d361 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:19.919172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd812579-f095-49d1-87ac-7f938036d361 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:20.211246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cd812579-f095-49d1-87ac-7f938036d361 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:20.236381 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cd812579-f095-49d1-87ac-7f938036d361 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:20.240577 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cd812579-f095-49d1-87ac-7f938036d361 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:20.244593 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cd812579-f095-49d1-87ac-7f938036d361 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1656 microversion: 2.20 time: 0.344397 Apr 14 16:16:20.246544 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 387/778] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:19 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1656 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:20.452472 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6b0f0387-0032-4b2f-b11c-4bb8880b2e82 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "POST /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/action" status: 202 len: 0 microversion: 2.1 time: 1.327758 Apr 14 16:16:20.456349 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 392/779] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:16:19 2021] POST /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/action => generated 0 bytes in 1330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:16:20.462182 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-5738511c-3341-4148-ad40-21b7a9e3dc09 req-3429bfa2-807a-4563-abe0-f2bf91f19886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93346a14-b6f5-4d77-a1a7-f4d649c7ccd5", "tag": "3a58c362-2e99-4559-9977-3b635ab88161"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:20.464644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:16:20.464644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:16:20.480090 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-5738511c-3341-4148-ad40-21b7a9e3dc09 req-3429bfa2-807a-4563-abe0-f2bf91f19886 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:20.481556 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-5738511c-3341-4148-ad40-21b7a9e3dc09 req-3429bfa2-807a-4563-abe0-f2bf91f19886 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:20.505154 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-5738511c-3341-4148-ad40-21b7a9e3dc09 req-3429bfa2-807a-4563-abe0-f2bf91f19886 service nova] Creating event network-changed:3a58c362-2e99-4559-9977-3b635ab88161 for instance 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 on hv-cinder-78626 Apr 14 16:16:20.529590 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-5738511c-3341-4148-ad40-21b7a9e3dc09 req-3429bfa2-807a-4563-abe0-f2bf91f19886 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070999 Apr 14 16:16:20.531815 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 388/780] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:16:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:16:21.138841 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-4cb6ce43-1fe8-4ca8-b5fa-395380885da4 req-493dbe94-b192-4328-9e58-1e8707b887f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e83f61-2715-436f-8d7c-88c4483cc0e5", "name": "network-vif-deleted", "tag": "d74de9c1-8188-4d05-92fc-6cdce0aa2e31"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:21.142053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:16:21.142053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:16:21.155386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-4cb6ce43-1fe8-4ca8-b5fa-395380885da4 req-493dbe94-b192-4328-9e58-1e8707b887f9 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:21.156316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-4cb6ce43-1fe8-4ca8-b5fa-395380885da4 req-493dbe94-b192-4328-9e58-1e8707b887f9 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:21.183472 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-4cb6ce43-1fe8-4ca8-b5fa-395380885da4 req-493dbe94-b192-4328-9e58-1e8707b887f9 service nova] Creating event network-vif-deleted:d74de9c1-8188-4d05-92fc-6cdce0aa2e31 for instance 97e83f61-2715-436f-8d7c-88c4483cc0e5 on hv-cinder-78626 Apr 14 16:16:21.190621 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-4cb6ce43-1fe8-4ca8-b5fa-395380885da4 req-493dbe94-b192-4328-9e58-1e8707b887f9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.316645 Apr 14 16:16:21.191630 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 393/781] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:16:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:16:21.267630 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e50b3f34-bc41-421b-95c0-b508ab77e1b9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:21.268390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e50b3f34-bc41-421b-95c0-b508ab77e1b9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:21.283704 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e50b3f34-bc41-421b-95c0-b508ab77e1b9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:21.284214 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e50b3f34-bc41-421b-95c0-b508ab77e1b9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:21.285951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e50b3f34-bc41-421b-95c0-b508ab77e1b9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:21.286453 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e50b3f34-bc41-421b-95c0-b508ab77e1b9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:21.406369 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e50b3f34-bc41-421b-95c0-b508ab77e1b9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:21.407023 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e50b3f34-bc41-421b-95c0-b508ab77e1b9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:21.408027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-e50b3f34-bc41-421b-95c0-b508ab77e1b9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lazy-loading 'fault' on Instance uuid 97e83f61-2715-436f-8d7c-88c4483cc0e5 {{(pid=99335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:16:21.512284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e50b3f34-bc41-421b-95c0-b508ab77e1b9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:21.532340 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e50b3f34-bc41-421b-95c0-b508ab77e1b9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:21.534516 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e50b3f34-bc41-421b-95c0-b508ab77e1b9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:21.536402 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e50b3f34-bc41-421b-95c0-b508ab77e1b9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 200 len: 1371 microversion: 2.20 time: 0.273394 Apr 14 16:16:21.549970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 389/782] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:21 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 1371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:22.560067 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9352ec49-7990-4769-83c0-c4adb032e0ca tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:22.561488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9352ec49-7990-4769-83c0-c4adb032e0ca tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:22.572318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9352ec49-7990-4769-83c0-c4adb032e0ca tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:22.573266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9352ec49-7990-4769-83c0-c4adb032e0ca tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:22.574398 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9352ec49-7990-4769-83c0-c4adb032e0ca tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:22.575538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9352ec49-7990-4769-83c0-c4adb032e0ca tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:22.667958 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-9352ec49-7990-4769-83c0-c4adb032e0ca tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] HTTP exception thrown: Instance 97e83f61-2715-436f-8d7c-88c4483cc0e5 could not be found. Apr 14 16:16:22.668899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9352ec49-7990-4769-83c0-c4adb032e0ca tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Returning 404 to user: Instance 97e83f61-2715-436f-8d7c-88c4483cc0e5 could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:16:22.670261 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9352ec49-7990-4769-83c0-c4adb032e0ca tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 404 len: 111 microversion: 2.20 time: 0.115041 Apr 14 16:16:22.671408 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 394/783] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:22 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 16:16:22.690479 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2576bf79-9895-4b71-aeda-f64bac16e981 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '.version_select at 0x7ff58d71fa60>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:22.724774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2576bf79-9895-4b71-aeda-f64bac16e981 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214528804" status: 204 len: 0 microversion: 2.20 time: 0.047805 Apr 14 16:16:22.739582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 390/784] 10.222.0.60 () {60 vars in 1252 bytes} [Wed Apr 14 16:16:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214528804 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 16:16:23.891657 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cf401f17-fa56-4687-8289-e2340f362b23 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:23.892107 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cf401f17-fa56-4687-8289-e2340f362b23 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:23.895284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-f1c615df-c592-4b6c-b55c-6a856b14c5be req-d92d00f1-54fc-482b-8530-b5dfba90e34d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93346a14-b6f5-4d77-a1a7-f4d649c7ccd5", "tag": "3a58c362-2e99-4559-9977-3b635ab88161"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:23.896991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:16:23.896991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:16:23.901282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cf401f17-fa56-4687-8289-e2340f362b23 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:23.901971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cf401f17-fa56-4687-8289-e2340f362b23 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:23.904344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cf401f17-fa56-4687-8289-e2340f362b23 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:23.905355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cf401f17-fa56-4687-8289-e2340f362b23 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:23.914172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-f1c615df-c592-4b6c-b55c-6a856b14c5be req-d92d00f1-54fc-482b-8530-b5dfba90e34d service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:23.921557 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-f1c615df-c592-4b6c-b55c-6a856b14c5be req-d92d00f1-54fc-482b-8530-b5dfba90e34d service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:23.941557 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-f1c615df-c592-4b6c-b55c-6a856b14c5be req-d92d00f1-54fc-482b-8530-b5dfba90e34d service nova] Creating event network-changed:3a58c362-2e99-4559-9977-3b635ab88161 for instance 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 on hv-cinder-78626 Apr 14 16:16:23.948038 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-f1c615df-c592-4b6c-b55c-6a856b14c5be req-d92d00f1-54fc-482b-8530-b5dfba90e34d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056466 Apr 14 16:16:23.948861 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 391/785] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:16:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:16:24.112819 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-cf401f17-fa56-4687-8289-e2340f362b23 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lazy-loading 'services' on Instance uuid 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:16:24.287906 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cf401f17-fa56-4687-8289-e2340f362b23 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "DELETE /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/os-volume_attachments/25677951-214b-4900-84ec-025fdeaf0307" status: 202 len: 0 microversion: 2.1 time: 0.400407 Apr 14 16:16:24.289022 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 395/786] 10.222.0.60 () {58 vars in 1406 bytes} [Wed Apr 14 16:16:23 2021] DELETE /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/os-volume_attachments/25677951-214b-4900-84ec-025fdeaf0307 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:16:24.302016 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a484b6e7-68c7-41f0-97fb-6f0019c299c6 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:24.303427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a484b6e7-68c7-41f0-97fb-6f0019c299c6 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:24.323546 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a484b6e7-68c7-41f0-97fb-6f0019c299c6 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:24.324462 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a484b6e7-68c7-41f0-97fb-6f0019c299c6 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:24.325648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a484b6e7-68c7-41f0-97fb-6f0019c299c6 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:24.326216 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a484b6e7-68c7-41f0-97fb-6f0019c299c6 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:24.439709 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a484b6e7-68c7-41f0-97fb-6f0019c299c6 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144419 Apr 14 16:16:24.444962 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 392/787] 10.222.0.60 () {58 vars in 1292 bytes} [Wed Apr 14 16:16:24 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:16:25.266061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0c879667-0e75-4601-b31b-756676150837 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'create', calling method: .version_select at 0x7ff58d7bdd90>, body: {"keypair": {"name": "tempest-keypair-480869655"}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:25.295469 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-0c879667-0e75-4601-b31b-756676150837 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Getting quotas for project 7c32c45b97f24aafbfc72c32f2ee651f. Resources: {'key_pairs'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:16:25.300220 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-0c879667-0e75-4601-b31b-756676150837 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Getting quotas for user 01801b3a85a648fb94444e671cbb4d18 and project 7c32c45b97f24aafbfc72c32f2ee651f. Resources: {'key_pairs'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:16:25.443012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-0c879667-0e75-4601-b31b-756676150837 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Getting quotas for project 7c32c45b97f24aafbfc72c32f2ee651f. Resources: {'key_pairs'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:16:25.447680 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-0c879667-0e75-4601-b31b-756676150837 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Getting quotas for user 01801b3a85a648fb94444e671cbb4d18 and project 7c32c45b97f24aafbfc72c32f2ee651f. Resources: {'key_pairs'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:16:25.452997 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3c66d86f-869f-40d8-bdbe-345a3f65f163 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:25.454313 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3c66d86f-869f-40d8-bdbe-345a3f65f163 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:25.462329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0c879667-0e75-4601-b31b-756676150837 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.201274 Apr 14 16:16:25.463052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 396/788] 10.222.0.60 () {62 vars in 1189 bytes} [Wed Apr 14 16:16:25 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 203 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 14 16:16:25.466043 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c66d86f-869f-40d8-bdbe-345a3f65f163 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:25.466559 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c66d86f-869f-40d8-bdbe-345a3f65f163 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:25.467414 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c66d86f-869f-40d8-bdbe-345a3f65f163 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:25.467909 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c66d86f-869f-40d8-bdbe-345a3f65f163 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:25.542733 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3c66d86f-869f-40d8-bdbe-345a3f65f163 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093803 Apr 14 16:16:25.548358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 393/789] 10.222.0.60 () {58 vars in 1292 bytes} [Wed Apr 14 16:16:25 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:16:25.554789 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6615712b-b151-406e-a463-9c025dc6df63 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:25.555359 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6615712b-b151-406e-a463-9c025dc6df63 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:25.564079 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6615712b-b151-406e-a463-9c025dc6df63 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:25.564683 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6615712b-b151-406e-a463-9c025dc6df63 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:25.565473 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6615712b-b151-406e-a463-9c025dc6df63 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:25.565976 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6615712b-b151-406e-a463-9c025dc6df63 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:25.762880 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-6615712b-b151-406e-a463-9c025dc6df63 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] HTTP exception thrown: Instance 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 is not attached to volume 25677951-214b-4900-84ec-025fdeaf0307 Apr 14 16:16:25.763959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6615712b-b151-406e-a463-9c025dc6df63 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Returning 404 to user: Instance 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 is not attached to volume 25677951-214b-4900-84ec-025fdeaf0307 {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:16:25.765829 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6615712b-b151-406e-a463-9c025dc6df63 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "DELETE /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/os-volume_attachments/25677951-214b-4900-84ec-025fdeaf0307" status: 404 len: 154 microversion: 2.1 time: 0.215696 Apr 14 16:16:25.766665 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 397/790] 10.222.0.60 () {58 vars in 1406 bytes} [Wed Apr 14 16:16:25 2021] DELETE /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5/os-volume_attachments/25677951-214b-4900-84ec-025fdeaf0307 => generated 154 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:16:27.054872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1acccda7-67bd-4d74-ab38-823016087bb7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:27.055426 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1acccda7-67bd-4d74-ab38-823016087bb7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:27.063394 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1acccda7-67bd-4d74-ab38-823016087bb7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:27.063910 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1acccda7-67bd-4d74-ab38-823016087bb7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:27.064763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1acccda7-67bd-4d74-ab38-823016087bb7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:27.065289 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1acccda7-67bd-4d74-ab38-823016087bb7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:27.135711 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1acccda7-67bd-4d74-ab38-823016087bb7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Going to try to terminate instance {{(pid=99335) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:16:27.253023 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1acccda7-67bd-4d74-ab38-823016087bb7 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "DELETE /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 204 len: 0 microversion: 2.1 time: 0.202239 Apr 14 16:16:27.253900 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 394/791] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:16:27 2021] DELETE /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:16:27.262532 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c666ec17-b97b-4e05-a6a7-3e4e7357b2eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:27.263195 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c666ec17-b97b-4e05-a6a7-3e4e7357b2eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:27.271019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c666ec17-b97b-4e05-a6a7-3e4e7357b2eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:27.271519 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c666ec17-b97b-4e05-a6a7-3e4e7357b2eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:27.272355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c666ec17-b97b-4e05-a6a7-3e4e7357b2eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:27.272844 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c666ec17-b97b-4e05-a6a7-3e4e7357b2eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:27.781790 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c666ec17-b97b-4e05-a6a7-3e4e7357b2eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:27.791286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c666ec17-b97b-4e05-a6a7-3e4e7357b2eb tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1554 microversion: 2.1 time: 0.531862 Apr 14 16:16:27.792006 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 398/792] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:27 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1554 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:27.834920 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-666192074", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452", "networks": [{"uuid": "e562779b-7387-40f5-b9de-d5621a56d934"}]}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:27.905723 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-360844499", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1543812-41fe-4295-b0c3-e4201c886b18"}], "security_groups": [{"name": "tempest-securitygroup--218071660"}], "key_name": "tempest-keypair-480869655", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:27.908975 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] validate_networks() for [('e562779b-7387-40f5-b9de-d5621a56d934', None, None, None)] {{(pid=99335) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:16:28.014348 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] validate_networks() for [('b1543812-41fe-4295-b0c3-e4201c886b18', None, None, None)] {{(pid=99334) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:16:28.736690 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Flavor limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:16:28.737275 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Image limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:16:28.737883 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Flavor pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:16:28.738349 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Image pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:16:28.738815 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:16:28.748783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:28.749324 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:28.750207 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:28.750694 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:28.770728 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Getting quotas for project 73844004f69a481dba93081e4d2b284e. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:16:28.775876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Getting quotas for user 5e44d70d92dd4dc69199692b1caca12d and project 73844004f69a481dba93081e4d2b284e. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:16:28.787727 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Going to run 1 instances... {{(pid=99335) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:16:28.790555 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:16:28.842356 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c5c6eb69-b7cc-4b75-afd0-958f763a1086 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.011779 Apr 14 16:16:28.843188 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 395/793] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:16:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:16:28.847629 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2e514221-983c-4e76-a422-e9b26b749a05 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:28.848368 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2e514221-983c-4e76-a422-e9b26b749a05 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:28.856472 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2e514221-983c-4e76-a422-e9b26b749a05 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:28.856977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2e514221-983c-4e76-a422-e9b26b749a05 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:28.857855 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2e514221-983c-4e76-a422-e9b26b749a05 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:28.858344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2e514221-983c-4e76-a422-e9b26b749a05 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:28.917764 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Flavor limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:16:28.918908 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Image limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:16:28.919792 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Flavor pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:16:28.920264 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Image pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:16:28.920734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:16:28.930651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:28.931257 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:28.932162 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:28.932651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:28.952362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Getting quotas for project 7c32c45b97f24aafbfc72c32f2ee651f. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:16:28.956709 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Getting quotas for user 01801b3a85a648fb94444e671cbb4d18 and project 7c32c45b97f24aafbfc72c32f2ee651f. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:16:28.968624 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Going to run 1 instances... {{(pid=99334) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:16:28.971294 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:16:29.026678 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e7eb893a-b314-4f55-86d8-d48ffc564923 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.125614 Apr 14 16:16:29.027637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 399/794] 10.222.0.60 () {62 vars in 1178 bytes} [Wed Apr 14 16:16:27 2021] POST /compute/v2.1/servers => generated 401 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 14 16:16:29.038055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f7ed6557-1e49-4ea9-aa52-15a8a8ed7176 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:29.038687 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f7ed6557-1e49-4ea9-aa52-15a8a8ed7176 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:29.072748 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2e514221-983c-4e76-a422-e9b26b749a05 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:29.082574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2e514221-983c-4e76-a422-e9b26b749a05 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1554 microversion: 2.1 time: 0.238344 Apr 14 16:16:29.083418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 396/795] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:28 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1554 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:29.088679 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-39899df5-ae31-4d3d-b602-a3b2fe448f1a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:29.089363 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-39899df5-ae31-4d3d-b602-a3b2fe448f1a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:29.142093 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f7ed6557-1e49-4ea9-aa52-15a8a8ed7176 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:29.151924 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f7ed6557-1e49-4ea9-aa52-15a8a8ed7176 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1218 microversion: 2.1 time: 0.117750 Apr 14 16:16:29.152898 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 400/796] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:29 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:29.194846 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-39899df5-ae31-4d3d-b602-a3b2fe448f1a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:29.207528 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-39899df5-ae31-4d3d-b602-a3b2fe448f1a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:29.209405 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-39899df5-ae31-4d3d-b602-a3b2fe448f1a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:29.210722 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-39899df5-ae31-4d3d-b602-a3b2fe448f1a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1280 microversion: 2.20 time: 0.126488 Apr 14 16:16:29.211616 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 397/797] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:29 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1280 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:30.101217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c154bdb7-66ac-4d0c-82b3-43edb46c2d48 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:30.101859 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c154bdb7-66ac-4d0c-82b3-43edb46c2d48 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:30.111622 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c154bdb7-66ac-4d0c-82b3-43edb46c2d48 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:30.112791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c154bdb7-66ac-4d0c-82b3-43edb46c2d48 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:30.114697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c154bdb7-66ac-4d0c-82b3-43edb46c2d48 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:30.115395 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c154bdb7-66ac-4d0c-82b3-43edb46c2d48 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:30.170367 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3f94ed56-8ebd-4b2f-b127-758f43abd38d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:30.171154 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3f94ed56-8ebd-4b2f-b127-758f43abd38d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:30.193578 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3f94ed56-8ebd-4b2f-b127-758f43abd38d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:30.194350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3f94ed56-8ebd-4b2f-b127-758f43abd38d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:30.195372 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3f94ed56-8ebd-4b2f-b127-758f43abd38d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:30.196030 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3f94ed56-8ebd-4b2f-b127-758f43abd38d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:30.381007 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3f94ed56-8ebd-4b2f-b127-758f43abd38d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:30.390969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3f94ed56-8ebd-4b2f-b127-758f43abd38d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1270 microversion: 2.1 time: 0.224634 Apr 14 16:16:30.392596 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 398/798] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:30 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1270 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:16:30.406041 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fe945f0c-b5b3-4bcf-9276-70482ab3bbc7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:30.407292 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fe945f0c-b5b3-4bcf-9276-70482ab3bbc7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:30.416648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fe945f0c-b5b3-4bcf-9276-70482ab3bbc7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:30.417502 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fe945f0c-b5b3-4bcf-9276-70482ab3bbc7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:30.418580 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fe945f0c-b5b3-4bcf-9276-70482ab3bbc7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:30.419282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fe945f0c-b5b3-4bcf-9276-70482ab3bbc7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:30.501970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c154bdb7-66ac-4d0c-82b3-43edb46c2d48 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:30.513108 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c154bdb7-66ac-4d0c-82b3-43edb46c2d48 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1554 microversion: 2.1 time: 0.415834 Apr 14 16:16:30.514741 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 401/799] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:30 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1554 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:30.668681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fe945f0c-b5b3-4bcf-9276-70482ab3bbc7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:30.681948 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fe945f0c-b5b3-4bcf-9276-70482ab3bbc7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:30.684375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fe945f0c-b5b3-4bcf-9276-70482ab3bbc7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:30.685720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fe945f0c-b5b3-4bcf-9276-70482ab3bbc7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1332 microversion: 2.20 time: 0.291564 Apr 14 16:16:30.686445 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 399/800] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:30 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1332 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:30.956822 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-54bd82d4-ce50-4501-8557-eb923539503b req-e0c6f5df-087b-48a5-ab06-202a6120b50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93346a14-b6f5-4d77-a1a7-f4d649c7ccd5", "name": "network-vif-deleted", "tag": "3a58c362-2e99-4559-9977-3b635ab88161"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:30.958986 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:16:30.958986 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:16:30.969735 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-54bd82d4-ce50-4501-8557-eb923539503b req-e0c6f5df-087b-48a5-ab06-202a6120b50f service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:30.970267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-54bd82d4-ce50-4501-8557-eb923539503b req-e0c6f5df-087b-48a5-ab06-202a6120b50f service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:30.990381 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-54bd82d4-ce50-4501-8557-eb923539503b req-e0c6f5df-087b-48a5-ab06-202a6120b50f service nova] Creating event network-vif-deleted:3a58c362-2e99-4559-9977-3b635ab88161 for instance 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 on hv-cinder-78626 Apr 14 16:16:30.996530 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-54bd82d4-ce50-4501-8557-eb923539503b req-e0c6f5df-087b-48a5-ab06-202a6120b50f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197621 Apr 14 16:16:30.999308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 402/801] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:16:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:16:31.409863 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b07c6cba-36b5-46fe-8a25-30b77a8f0420 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:31.410662 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b07c6cba-36b5-46fe-8a25-30b77a8f0420 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:31.419686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b07c6cba-36b5-46fe-8a25-30b77a8f0420 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:31.420215 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b07c6cba-36b5-46fe-8a25-30b77a8f0420 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:31.421099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b07c6cba-36b5-46fe-8a25-30b77a8f0420 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:31.421603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b07c6cba-36b5-46fe-8a25-30b77a8f0420 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:31.533245 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0b2ecb92-f647-4c7e-8134-2a3063a7be15 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:31.534021 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0b2ecb92-f647-4c7e-8134-2a3063a7be15 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:31.544979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0b2ecb92-f647-4c7e-8134-2a3063a7be15 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:31.545634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0b2ecb92-f647-4c7e-8134-2a3063a7be15 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:31.546490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0b2ecb92-f647-4c7e-8134-2a3063a7be15 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:31.546981 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0b2ecb92-f647-4c7e-8134-2a3063a7be15 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:31.606943 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b07c6cba-36b5-46fe-8a25-30b77a8f0420 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:31.616146 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b07c6cba-36b5-46fe-8a25-30b77a8f0420 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1276 microversion: 2.1 time: 0.210467 Apr 14 16:16:31.617067 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 400/802] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:31 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1276 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:31.631686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0b2ecb92-f647-4c7e-8134-2a3063a7be15 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:31.632197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0b2ecb92-f647-4c7e-8134-2a3063a7be15 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:31.632715 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-0b2ecb92-f647-4c7e-8134-2a3063a7be15 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lazy-loading 'fault' on Instance uuid 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:16:31.706620 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bedf821f-55f2-4e6e-bbd4-fde0e6e5a146 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:31.707294 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bedf821f-55f2-4e6e-bbd4-fde0e6e5a146 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:31.716290 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0b2ecb92-f647-4c7e-8134-2a3063a7be15 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b308998794d4586b99c9d8eb562751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e71c42092894db98f8db75a2719f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:31.722061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bedf821f-55f2-4e6e-bbd4-fde0e6e5a146 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:31.722581 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bedf821f-55f2-4e6e-bbd4-fde0e6e5a146 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:31.723442 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bedf821f-55f2-4e6e-bbd4-fde0e6e5a146 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:31.723936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bedf821f-55f2-4e6e-bbd4-fde0e6e5a146 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:31.725111 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0b2ecb92-f647-4c7e-8134-2a3063a7be15 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 200 len: 1348 microversion: 2.1 time: 0.196619 Apr 14 16:16:31.725881 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 403/803] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:31 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 1348 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:31.920326 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bedf821f-55f2-4e6e-bbd4-fde0e6e5a146 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:31.929824 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bedf821f-55f2-4e6e-bbd4-fde0e6e5a146 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:31.931708 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bedf821f-55f2-4e6e-bbd4-fde0e6e5a146 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:31.932888 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bedf821f-55f2-4e6e-bbd4-fde0e6e5a146 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1338 microversion: 2.20 time: 0.230404 Apr 14 16:16:31.933555 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 401/804] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:31 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1338 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:16:32.635631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8faef550-ae3f-45f9-a3e6-5af311b518d1 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:32.636408 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8faef550-ae3f-45f9-a3e6-5af311b518d1 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:32.644314 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8faef550-ae3f-45f9-a3e6-5af311b518d1 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:32.644825 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8faef550-ae3f-45f9-a3e6-5af311b518d1 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:32.645707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8faef550-ae3f-45f9-a3e6-5af311b518d1 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:32.646194 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8faef550-ae3f-45f9-a3e6-5af311b518d1 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:32.743907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a2b70048-472a-456d-9c63-e3cf0243b373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:32.744754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a2b70048-472a-456d-9c63-e3cf0243b373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] [instance: 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:32.752688 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2b70048-472a-456d-9c63-e3cf0243b373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:32.753235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2b70048-472a-456d-9c63-e3cf0243b373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:32.754096 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2b70048-472a-456d-9c63-e3cf0243b373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:32.754599 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2b70048-472a-456d-9c63-e3cf0243b373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:32.809758 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-a2b70048-472a-456d-9c63-e3cf0243b373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] HTTP exception thrown: Instance 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 could not be found. Apr 14 16:16:32.810442 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a2b70048-472a-456d-9c63-e3cf0243b373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Returning 404 to user: Instance 93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:16:32.811369 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a2b70048-472a-456d-9c63-e3cf0243b373 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5" status: 404 len: 111 microversion: 2.1 time: 0.072107 Apr 14 16:16:32.812250 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 402/805] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:32 2021] GET /compute/v2.1/servers/93346a14-b6f5-4d77-a1a7-f4d649c7ccd5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:16:32.820391 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-86fc2b42-0727-44cd-9483-2a45d59de7c0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] Calling method '.version_select at 0x7ff58e069730>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:32.837997 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-86fc2b42-0727-44cd-9483-2a45d59de7c0 tempest-TestMinimumBasicScenario-1138752196 tempest-TestMinimumBasicScenario-1138752196-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-106284262" status: 202 len: 0 microversion: 2.1 time: 0.020750 Apr 14 16:16:32.839070 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 403/806] 10.222.0.60 () {58 vars in 1259 bytes} [Wed Apr 14 16:16:32 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-106284262 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:16:32.878046 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8faef550-ae3f-45f9-a3e6-5af311b518d1 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:32.887608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8faef550-ae3f-45f9-a3e6-5af311b518d1 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1318 microversion: 2.1 time: 0.256055 Apr 14 16:16:32.888418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 404/807] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:32 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:32.955913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-651219ab-7dd7-487c-9e7e-fdccea5dc8f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:32.964557 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-651219ab-7dd7-487c-9e7e-fdccea5dc8f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:32.973132 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-651219ab-7dd7-487c-9e7e-fdccea5dc8f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:32.973642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-651219ab-7dd7-487c-9e7e-fdccea5dc8f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:32.974606 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-651219ab-7dd7-487c-9e7e-fdccea5dc8f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:32.974959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-651219ab-7dd7-487c-9e7e-fdccea5dc8f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:33.543292 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-651219ab-7dd7-487c-9e7e-fdccea5dc8f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:33.554203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-651219ab-7dd7-487c-9e7e-fdccea5dc8f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:33.556826 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-651219ab-7dd7-487c-9e7e-fdccea5dc8f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:33.558125 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-651219ab-7dd7-487c-9e7e-fdccea5dc8f3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1405 microversion: 2.20 time: 0.609404 Apr 14 16:16:33.558728 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 404/808] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:32 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1405 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:33.905946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1fb29256-93ef-4dd5-a3ed-2284c1e94d99 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:33.906618 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1fb29256-93ef-4dd5-a3ed-2284c1e94d99 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:33.915078 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1fb29256-93ef-4dd5-a3ed-2284c1e94d99 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:33.915969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1fb29256-93ef-4dd5-a3ed-2284c1e94d99 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:33.916812 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1fb29256-93ef-4dd5-a3ed-2284c1e94d99 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:33.917519 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1fb29256-93ef-4dd5-a3ed-2284c1e94d99 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:34.186325 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1fb29256-93ef-4dd5-a3ed-2284c1e94d99 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:34.195754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1fb29256-93ef-4dd5-a3ed-2284c1e94d99 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1318 microversion: 2.1 time: 0.294219 Apr 14 16:16:34.196574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 405/809] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:33 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:34.578339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b8e85832-36d0-4b84-8533-4c387c29fd71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:34.579017 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b8e85832-36d0-4b84-8533-4c387c29fd71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:34.589005 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8e85832-36d0-4b84-8533-4c387c29fd71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:34.589538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8e85832-36d0-4b84-8533-4c387c29fd71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:34.590947 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8e85832-36d0-4b84-8533-4c387c29fd71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:34.591472 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8e85832-36d0-4b84-8533-4c387c29fd71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:35.104064 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-433bc34e-9294-4361-91d3-4ebda6814c60 req-c06237a4-8a7c-4cfe-87d0-8204c4c31831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c19596f-1b41-4441-aac8-f715ca5e16d7", "tag": "8524978b-5f78-400b-b215-ca84451f8af6"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:35.106259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:16:35.106259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:16:35.155159 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-433bc34e-9294-4361-91d3-4ebda6814c60 req-c06237a4-8a7c-4cfe-87d0-8204c4c31831 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:35.155673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-433bc34e-9294-4361-91d3-4ebda6814c60 req-c06237a4-8a7c-4cfe-87d0-8204c4c31831 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:35.174660 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-433bc34e-9294-4361-91d3-4ebda6814c60 req-c06237a4-8a7c-4cfe-87d0-8204c4c31831 service nova] Creating event network-changed:8524978b-5f78-400b-b215-ca84451f8af6 for instance 6c19596f-1b41-4441-aac8-f715ca5e16d7 on hv-cinder-78626 Apr 14 16:16:35.179848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-433bc34e-9294-4361-91d3-4ebda6814c60 req-c06237a4-8a7c-4cfe-87d0-8204c4c31831 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080095 Apr 14 16:16:35.181076 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 406/810] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:16:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:16:35.215928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-843e3f83-004c-4c14-b676-3ea684f609db tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:35.216704 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-843e3f83-004c-4c14-b676-3ea684f609db tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:35.226018 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-843e3f83-004c-4c14-b676-3ea684f609db tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:35.226997 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-843e3f83-004c-4c14-b676-3ea684f609db tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:35.228594 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-843e3f83-004c-4c14-b676-3ea684f609db tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:35.229427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-843e3f83-004c-4c14-b676-3ea684f609db tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:35.370086 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b8e85832-36d0-4b84-8533-4c387c29fd71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:35.380300 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b8e85832-36d0-4b84-8533-4c387c29fd71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:35.382550 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b8e85832-36d0-4b84-8533-4c387c29fd71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:35.384623 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b8e85832-36d0-4b84-8533-4c387c29fd71 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1405 microversion: 2.20 time: 0.809322 Apr 14 16:16:35.385341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 405/811] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:34 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1405 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:16:36.022197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-843e3f83-004c-4c14-b676-3ea684f609db tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:36.031738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-843e3f83-004c-4c14-b676-3ea684f609db tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1318 microversion: 2.1 time: 0.821518 Apr 14 16:16:36.032660 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 407/812] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:35 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1318 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:36.405583 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c518f36e-9228-4321-8bce-e53523428590 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:36.406437 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c518f36e-9228-4321-8bce-e53523428590 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:36.414562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c518f36e-9228-4321-8bce-e53523428590 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:36.415134 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c518f36e-9228-4321-8bce-e53523428590 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:36.415982 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c518f36e-9228-4321-8bce-e53523428590 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:36.416470 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c518f36e-9228-4321-8bce-e53523428590 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:36.860780 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c518f36e-9228-4321-8bce-e53523428590 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:36.871854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c518f36e-9228-4321-8bce-e53523428590 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:36.874302 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c518f36e-9228-4321-8bce-e53523428590 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:36.875734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c518f36e-9228-4321-8bce-e53523428590 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1405 microversion: 2.20 time: 0.475051 Apr 14 16:16:36.876626 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 406/813] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:36 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:37.049555 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5e13739b-9681-4643-bd65-8e50aba4145c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:37.050475 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5e13739b-9681-4643-bd65-8e50aba4145c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:37.059338 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e13739b-9681-4643-bd65-8e50aba4145c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:37.060152 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e13739b-9681-4643-bd65-8e50aba4145c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:37.061250 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e13739b-9681-4643-bd65-8e50aba4145c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:37.061936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e13739b-9681-4643-bd65-8e50aba4145c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:37.267206 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-e4e8fdbf-92f3-482b-8a2c-6d097a7a531c req-927dfc63-6d70-4268-84c1-0b63acc74e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e45e06-d4ec-48d7-8576-da008e2a2bbe", "tag": "86985f08-70cd-4417-8f18-ff0ada9a82ff"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:37.269755 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:16:37.269755 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:16:37.280818 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-e4e8fdbf-92f3-482b-8a2c-6d097a7a531c req-927dfc63-6d70-4268-84c1-0b63acc74e4e service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:37.281353 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-e4e8fdbf-92f3-482b-8a2c-6d097a7a531c req-927dfc63-6d70-4268-84c1-0b63acc74e4e service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:37.304854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-e4e8fdbf-92f3-482b-8a2c-6d097a7a531c req-927dfc63-6d70-4268-84c1-0b63acc74e4e service nova] Creating event network-changed:86985f08-70cd-4417-8f18-ff0ada9a82ff for instance 67e45e06-d4ec-48d7-8576-da008e2a2bbe on hv-cinder-78626 Apr 14 16:16:37.323637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-e4e8fdbf-92f3-482b-8a2c-6d097a7a531c req-927dfc63-6d70-4268-84c1-0b63acc74e4e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055768 Apr 14 16:16:37.327725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 407/814] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:16:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:16:37.820715 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5e13739b-9681-4643-bd65-8e50aba4145c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:37.830964 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5e13739b-9681-4643-bd65-8e50aba4145c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1318 microversion: 2.1 time: 0.785328 Apr 14 16:16:37.841896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 408/815] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:37 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1318 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:37.897478 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1e9747d9-8255-41aa-ab90-79fe197c4055 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:37.898692 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1e9747d9-8255-41aa-ab90-79fe197c4055 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:37.909885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e9747d9-8255-41aa-ab90-79fe197c4055 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:37.911297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e9747d9-8255-41aa-ab90-79fe197c4055 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:37.911297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e9747d9-8255-41aa-ab90-79fe197c4055 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:37.911633 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e9747d9-8255-41aa-ab90-79fe197c4055 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:38.376326 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1e9747d9-8255-41aa-ab90-79fe197c4055 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:38.387534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1e9747d9-8255-41aa-ab90-79fe197c4055 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:38.390352 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1e9747d9-8255-41aa-ab90-79fe197c4055 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:38.391479 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1e9747d9-8255-41aa-ab90-79fe197c4055 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1405 microversion: 2.20 time: 0.498531 Apr 14 16:16:38.394430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 408/816] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:37 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1405 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:38.849384 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5e728b2f-9c11-4e97-8404-6b290339ed42 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:38.850059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5e728b2f-9c11-4e97-8404-6b290339ed42 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:38.858839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e728b2f-9c11-4e97-8404-6b290339ed42 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:38.859349 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e728b2f-9c11-4e97-8404-6b290339ed42 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:38.860188 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e728b2f-9c11-4e97-8404-6b290339ed42 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:38.860677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5e728b2f-9c11-4e97-8404-6b290339ed42 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:39.191016 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5e728b2f-9c11-4e97-8404-6b290339ed42 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:39.203962 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5e728b2f-9c11-4e97-8404-6b290339ed42 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1318 microversion: 2.1 time: 0.356435 Apr 14 16:16:39.209247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 409/817] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:38 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:39.411437 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3194a629-965d-4c9c-8ee9-cdc3c2333035 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:39.412323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3194a629-965d-4c9c-8ee9-cdc3c2333035 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:39.421651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3194a629-965d-4c9c-8ee9-cdc3c2333035 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:39.422157 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3194a629-965d-4c9c-8ee9-cdc3c2333035 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:39.422992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3194a629-965d-4c9c-8ee9-cdc3c2333035 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:39.423463 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3194a629-965d-4c9c-8ee9-cdc3c2333035 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:39.628494 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3194a629-965d-4c9c-8ee9-cdc3c2333035 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:39.638507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3194a629-965d-4c9c-8ee9-cdc3c2333035 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:39.640188 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3194a629-965d-4c9c-8ee9-cdc3c2333035 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:39.641438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3194a629-965d-4c9c-8ee9-cdc3c2333035 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1405 microversion: 2.20 time: 0.234717 Apr 14 16:16:39.642269 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 409/818] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:39 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:40.223090 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e3aba554-39e5-4892-9d67-768c8bd4842b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:40.224686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e3aba554-39e5-4892-9d67-768c8bd4842b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:40.232616 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e3aba554-39e5-4892-9d67-768c8bd4842b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:40.233308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e3aba554-39e5-4892-9d67-768c8bd4842b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:40.234150 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e3aba554-39e5-4892-9d67-768c8bd4842b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:40.234639 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e3aba554-39e5-4892-9d67-768c8bd4842b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:40.627759 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e3aba554-39e5-4892-9d67-768c8bd4842b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:40.637602 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e3aba554-39e5-4892-9d67-768c8bd4842b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1318 microversion: 2.1 time: 0.418869 Apr 14 16:16:40.638244 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 410/819] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:40 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:40.660651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ceb29994-acbe-4cdd-94c2-4b6e44ca285e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:40.661377 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ceb29994-acbe-4cdd-94c2-4b6e44ca285e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:40.669662 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ceb29994-acbe-4cdd-94c2-4b6e44ca285e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:40.670179 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ceb29994-acbe-4cdd-94c2-4b6e44ca285e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:40.671026 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ceb29994-acbe-4cdd-94c2-4b6e44ca285e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:40.671524 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ceb29994-acbe-4cdd-94c2-4b6e44ca285e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:40.872392 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ceb29994-acbe-4cdd-94c2-4b6e44ca285e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:40.881973 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ceb29994-acbe-4cdd-94c2-4b6e44ca285e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:40.883866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ceb29994-acbe-4cdd-94c2-4b6e44ca285e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:40.885264 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ceb29994-acbe-4cdd-94c2-4b6e44ca285e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1405 microversion: 2.20 time: 0.228910 Apr 14 16:16:40.885897 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 410/820] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:40 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:41.628972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-bef97390-4de1-44d0-ba1d-7cd07600f225 req-7ab83562-b89d-4345-a116-76a58d98db1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c19596f-1b41-4441-aac8-f715ca5e16d7", "name": "network-vif-plugged", "status": "completed", "tag": "8524978b-5f78-400b-b215-ca84451f8af6"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:41.630780 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:16:41.630780 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:16:41.640583 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-bef97390-4de1-44d0-ba1d-7cd07600f225 req-7ab83562-b89d-4345-a116-76a58d98db1b service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:41.641135 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-bef97390-4de1-44d0-ba1d-7cd07600f225 req-7ab83562-b89d-4345-a116-76a58d98db1b service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:41.656077 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fb8a680b-7dd7-4d88-b50a-a011ddbecd11 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:41.657153 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fb8a680b-7dd7-4d88-b50a-a011ddbecd11 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:41.663876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-bef97390-4de1-44d0-ba1d-7cd07600f225 req-7ab83562-b89d-4345-a116-76a58d98db1b service nova] Creating event network-vif-plugged:8524978b-5f78-400b-b215-ca84451f8af6 for instance 6c19596f-1b41-4441-aac8-f715ca5e16d7 on hv-cinder-78626 Apr 14 16:16:41.672265 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-bef97390-4de1-44d0-ba1d-7cd07600f225 req-7ab83562-b89d-4345-a116-76a58d98db1b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111226 Apr 14 16:16:41.673346 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 411/821] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:16:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:16:41.674263 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb8a680b-7dd7-4d88-b50a-a011ddbecd11 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:41.674773 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb8a680b-7dd7-4d88-b50a-a011ddbecd11 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:41.675640 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb8a680b-7dd7-4d88-b50a-a011ddbecd11 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:41.676110 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fb8a680b-7dd7-4d88-b50a-a011ddbecd11 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:41.920394 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-864aaaa9-f0c1-4113-8a56-3a594f270281 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:41.924975 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-864aaaa9-f0c1-4113-8a56-3a594f270281 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:41.949612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-864aaaa9-f0c1-4113-8a56-3a594f270281 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:41.950249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-864aaaa9-f0c1-4113-8a56-3a594f270281 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:41.951652 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-864aaaa9-f0c1-4113-8a56-3a594f270281 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:41.951791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-864aaaa9-f0c1-4113-8a56-3a594f270281 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:42.024266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fb8a680b-7dd7-4d88-b50a-a011ddbecd11 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:42.041958 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fb8a680b-7dd7-4d88-b50a-a011ddbecd11 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1318 microversion: 2.1 time: 0.389629 Apr 14 16:16:42.042648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 411/822] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:41 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:16:42.281444 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-864aaaa9-f0c1-4113-8a56-3a594f270281 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:42.291878 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-864aaaa9-f0c1-4113-8a56-3a594f270281 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:42.293623 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-864aaaa9-f0c1-4113-8a56-3a594f270281 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:42.294792 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-864aaaa9-f0c1-4113-8a56-3a594f270281 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1405 microversion: 2.20 time: 0.393925 Apr 14 16:16:42.295401 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 412/823] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:41 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:43.060793 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-538e0921-31f1-470e-be3d-0cb07e5abd5c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:43.061865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-538e0921-31f1-470e-be3d-0cb07e5abd5c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:43.070520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-538e0921-31f1-470e-be3d-0cb07e5abd5c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:43.071570 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-538e0921-31f1-470e-be3d-0cb07e5abd5c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:43.072777 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-538e0921-31f1-470e-be3d-0cb07e5abd5c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:43.072895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-538e0921-31f1-470e-be3d-0cb07e5abd5c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:43.316318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3a9257f9-af39-4b0a-8d7d-45ded5acde12 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:43.317126 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3a9257f9-af39-4b0a-8d7d-45ded5acde12 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:43.326812 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3a9257f9-af39-4b0a-8d7d-45ded5acde12 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:43.327435 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3a9257f9-af39-4b0a-8d7d-45ded5acde12 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:43.328390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3a9257f9-af39-4b0a-8d7d-45ded5acde12 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:43.328984 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3a9257f9-af39-4b0a-8d7d-45ded5acde12 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:43.398216 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-538e0921-31f1-470e-be3d-0cb07e5abd5c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:43.411628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-538e0921-31f1-470e-be3d-0cb07e5abd5c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1318 microversion: 2.1 time: 0.355059 Apr 14 16:16:43.412287 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 412/824] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:43 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:43.714265 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-8c17b37f-4f6d-4ea7-a20b-0d6220fb2041 req-9b49671b-baa1-424e-bc8e-941ec6d37bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e45e06-d4ec-48d7-8576-da008e2a2bbe", "name": "network-vif-plugged", "status": "completed", "tag": "86985f08-70cd-4417-8f18-ff0ada9a82ff"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:43.716134 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:16:43.716134 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:16:43.725000 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-8c17b37f-4f6d-4ea7-a20b-0d6220fb2041 req-9b49671b-baa1-424e-bc8e-941ec6d37bf7 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:43.725540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-8c17b37f-4f6d-4ea7-a20b-0d6220fb2041 req-9b49671b-baa1-424e-bc8e-941ec6d37bf7 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:43.743798 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-8c17b37f-4f6d-4ea7-a20b-0d6220fb2041 req-9b49671b-baa1-424e-bc8e-941ec6d37bf7 service nova] Creating event network-vif-plugged:86985f08-70cd-4417-8f18-ff0ada9a82ff for instance 67e45e06-d4ec-48d7-8576-da008e2a2bbe on hv-cinder-78626 Apr 14 16:16:43.749008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-8c17b37f-4f6d-4ea7-a20b-0d6220fb2041 req-9b49671b-baa1-424e-bc8e-941ec6d37bf7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039684 Apr 14 16:16:43.749931 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 413/825] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:16:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:16:43.782107 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3a9257f9-af39-4b0a-8d7d-45ded5acde12 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:43.791935 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3a9257f9-af39-4b0a-8d7d-45ded5acde12 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:43.793514 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3a9257f9-af39-4b0a-8d7d-45ded5acde12 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:43.794697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3a9257f9-af39-4b0a-8d7d-45ded5acde12 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1405 microversion: 2.20 time: 0.483317 Apr 14 16:16:43.795317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 413/826] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:43 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:44.431260 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-54abc497-3675-45b1-b965-27ac2ec259f8 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:44.432236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-54abc497-3675-45b1-b965-27ac2ec259f8 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:44.445532 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54abc497-3675-45b1-b965-27ac2ec259f8 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:44.446582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54abc497-3675-45b1-b965-27ac2ec259f8 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:44.447478 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54abc497-3675-45b1-b965-27ac2ec259f8 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:44.447976 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54abc497-3675-45b1-b965-27ac2ec259f8 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:44.715093 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-54abc497-3675-45b1-b965-27ac2ec259f8 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:44.724032 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-54abc497-3675-45b1-b965-27ac2ec259f8 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1507 microversion: 2.1 time: 0.297676 Apr 14 16:16:44.724668 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 414/827] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:44 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1507 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:44.814633 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-69e73a97-7f20-4792-85f3-5e760b7c4744 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:44.815701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-69e73a97-7f20-4792-85f3-5e760b7c4744 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:44.824161 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-69e73a97-7f20-4792-85f3-5e760b7c4744 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:44.824885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-69e73a97-7f20-4792-85f3-5e760b7c4744 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:44.826064 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-69e73a97-7f20-4792-85f3-5e760b7c4744 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:44.826717 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-69e73a97-7f20-4792-85f3-5e760b7c4744 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:45.338885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-69e73a97-7f20-4792-85f3-5e760b7c4744 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:45.354710 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-69e73a97-7f20-4792-85f3-5e760b7c4744 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:45.356386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-69e73a97-7f20-4792-85f3-5e760b7c4744 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:45.357600 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-69e73a97-7f20-4792-85f3-5e760b7c4744 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1405 microversion: 2.20 time: 0.547018 Apr 14 16:16:45.358205 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 414/828] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:44 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1405 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:46.378963 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7d0edd08-6076-4a50-9a0f-7895b7bc19a4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:46.378963 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7d0edd08-6076-4a50-9a0f-7895b7bc19a4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:46.386221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d0edd08-6076-4a50-9a0f-7895b7bc19a4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:46.386732 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d0edd08-6076-4a50-9a0f-7895b7bc19a4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:46.387588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d0edd08-6076-4a50-9a0f-7895b7bc19a4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:46.388084 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d0edd08-6076-4a50-9a0f-7895b7bc19a4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:46.600151 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7d0edd08-6076-4a50-9a0f-7895b7bc19a4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:46.614203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7d0edd08-6076-4a50-9a0f-7895b7bc19a4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:46.616018 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7d0edd08-6076-4a50-9a0f-7895b7bc19a4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:46.618148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7d0edd08-6076-4a50-9a0f-7895b7bc19a4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1598 microversion: 2.20 time: 0.245458 Apr 14 16:16:46.619604 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 415/829] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:16:46 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1598 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:16:46.639230 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6a0ef8c2-61e8-4eaf-b6b0-4ad4ec48b80c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:46.639230 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6a0ef8c2-61e8-4eaf-b6b0-4ad4ec48b80c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:46.646802 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a0ef8c2-61e8-4eaf-b6b0-4ad4ec48b80c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:46.647288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a0ef8c2-61e8-4eaf-b6b0-4ad4ec48b80c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:46.648368 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a0ef8c2-61e8-4eaf-b6b0-4ad4ec48b80c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:46.648999 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a0ef8c2-61e8-4eaf-b6b0-4ad4ec48b80c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:46.891555 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6a0ef8c2-61e8-4eaf-b6b0-4ad4ec48b80c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.257853 Apr 14 16:16:46.892306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 415/830] 10.222.0.60 () {60 vars in 1306 bytes} [Wed Apr 14 16:16:46 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/os-interface => generated 285 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:16:49.034122 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-eb25a22b-78b9-4aba-a467-06281a7563a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:49.036212 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-eb25a22b-78b9-4aba-a467-06281a7563a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:49.049087 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb25a22b-78b9-4aba-a467-06281a7563a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:49.049606 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb25a22b-78b9-4aba-a467-06281a7563a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:49.050473 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb25a22b-78b9-4aba-a467-06281a7563a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:49.050975 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb25a22b-78b9-4aba-a467-06281a7563a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:49.051175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-89956f9b-d2a1-497c-a905-e66a15355797 req-3de16542-94fa-4006-9539-50e7ba37adc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e45e06-d4ec-48d7-8576-da008e2a2bbe", "tag": "86985f08-70cd-4417-8f18-ff0ada9a82ff"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:49.053122 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:16:49.053122 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:16:49.073636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-89956f9b-d2a1-497c-a905-e66a15355797 req-3de16542-94fa-4006-9539-50e7ba37adc3 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:49.074139 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-89956f9b-d2a1-497c-a905-e66a15355797 req-3de16542-94fa-4006-9539-50e7ba37adc3 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:49.117376 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-89956f9b-d2a1-497c-a905-e66a15355797 req-3de16542-94fa-4006-9539-50e7ba37adc3 service nova] Creating event network-changed:86985f08-70cd-4417-8f18-ff0ada9a82ff for instance 67e45e06-d4ec-48d7-8576-da008e2a2bbe on hv-cinder-78626 Apr 14 16:16:49.135660 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-89956f9b-d2a1-497c-a905-e66a15355797 req-3de16542-94fa-4006-9539-50e7ba37adc3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088389 Apr 14 16:16:49.136615 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 416/831] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:16:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:16:49.189641 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-eb25a22b-78b9-4aba-a467-06281a7563a8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 14 microversion: 2.20 time: 0.159734 Apr 14 16:16:49.190589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 416/832] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:16:49 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:49.362707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a5f4af45-9491-4d32-a0ad-aeb7564df04c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:49.363879 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a5f4af45-9491-4d32-a0ad-aeb7564df04c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:49.373494 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5f4af45-9491-4d32-a0ad-aeb7564df04c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:49.374296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5f4af45-9491-4d32-a0ad-aeb7564df04c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:49.375472 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5f4af45-9491-4d32-a0ad-aeb7564df04c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:49.376171 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a5f4af45-9491-4d32-a0ad-aeb7564df04c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:49.463647 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a5f4af45-9491-4d32-a0ad-aeb7564df04c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Going to try to terminate instance {{(pid=99334) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:16:49.612026 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a5f4af45-9491-4d32-a0ad-aeb7564df04c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 204 len: 0 microversion: 2.1 time: 0.254121 Apr 14 16:16:49.612972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 417/833] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:16:49 2021] DELETE /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:16:49.623923 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8beb934b-8854-4783-84e8-4d5534feb9f1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:49.625009 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8beb934b-8854-4783-84e8-4d5534feb9f1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:49.635645 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8beb934b-8854-4783-84e8-4d5534feb9f1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:49.637339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8beb934b-8854-4783-84e8-4d5534feb9f1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:49.638610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8beb934b-8854-4783-84e8-4d5534feb9f1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:49.639747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8beb934b-8854-4783-84e8-4d5534feb9f1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:50.006205 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8beb934b-8854-4783-84e8-4d5534feb9f1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:50.017718 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8beb934b-8854-4783-84e8-4d5534feb9f1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1671 microversion: 2.1 time: 0.398308 Apr 14 16:16:50.030429 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 417/834] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:49 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1671 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:50.203113 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-06faf378-f95b-47d8-af6d-54650c192623 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:50.204254 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-06faf378-f95b-47d8-af6d-54650c192623 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:50.213247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06faf378-f95b-47d8-af6d-54650c192623 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:50.214119 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06faf378-f95b-47d8-af6d-54650c192623 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:50.215124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06faf378-f95b-47d8-af6d-54650c192623 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:50.215774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06faf378-f95b-47d8-af6d-54650c192623 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:50.343823 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-06faf378-f95b-47d8-af6d-54650c192623 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 14 microversion: 2.20 time: 0.144914 Apr 14 16:16:50.347250 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 418/835] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:16:50 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:51.037622 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a6d1b520-022b-4f45-84e2-153628ee37a0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:51.038308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a6d1b520-022b-4f45-84e2-153628ee37a0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:51.048061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a6d1b520-022b-4f45-84e2-153628ee37a0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:51.049053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a6d1b520-022b-4f45-84e2-153628ee37a0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:51.050127 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a6d1b520-022b-4f45-84e2-153628ee37a0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:51.050809 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a6d1b520-022b-4f45-84e2-153628ee37a0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:51.333168 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a6d1b520-022b-4f45-84e2-153628ee37a0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:51.343552 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a6d1b520-022b-4f45-84e2-153628ee37a0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1671 microversion: 2.1 time: 0.309793 Apr 14 16:16:51.344289 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 418/836] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:51 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1671 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:51.357800 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b018ffc5-778b-434c-9b7a-e46e66599af6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:51.359311 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b018ffc5-778b-434c-9b7a-e46e66599af6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:51.375512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b018ffc5-778b-434c-9b7a-e46e66599af6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:51.376026 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b018ffc5-778b-434c-9b7a-e46e66599af6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:51.376884 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b018ffc5-778b-434c-9b7a-e46e66599af6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:51.377404 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b018ffc5-778b-434c-9b7a-e46e66599af6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:51.502858 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b018ffc5-778b-434c-9b7a-e46e66599af6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 14 microversion: 2.20 time: 0.147326 Apr 14 16:16:51.502858 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 419/837] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:16:51 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:52.362538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b7b05c45-4f8a-4931-9950-0f6cb6c5a28d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:52.363349 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b7b05c45-4f8a-4931-9950-0f6cb6c5a28d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:52.372634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b7b05c45-4f8a-4931-9950-0f6cb6c5a28d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:52.373332 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b7b05c45-4f8a-4931-9950-0f6cb6c5a28d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:52.374192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b7b05c45-4f8a-4931-9950-0f6cb6c5a28d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:52.374695 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b7b05c45-4f8a-4931-9950-0f6cb6c5a28d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:52.513466 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-710588f0-13f9-41c2-9742-1c23336f4325 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:52.514714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-710588f0-13f9-41c2-9742-1c23336f4325 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:52.524350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-710588f0-13f9-41c2-9742-1c23336f4325 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:52.524855 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-710588f0-13f9-41c2-9742-1c23336f4325 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:52.525756 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-710588f0-13f9-41c2-9742-1c23336f4325 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:52.526242 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-710588f0-13f9-41c2-9742-1c23336f4325 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:52.645144 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-710588f0-13f9-41c2-9742-1c23336f4325 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 14 microversion: 2.20 time: 0.137148 Apr 14 16:16:52.649577 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 420/838] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:16:52 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:16:52.762819 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b7b05c45-4f8a-4931-9950-0f6cb6c5a28d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:52.773451 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b7b05c45-4f8a-4931-9950-0f6cb6c5a28d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1671 microversion: 2.1 time: 0.414730 Apr 14 16:16:52.781235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 419/839] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:52 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1671 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:53.382436 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-d2836845-60eb-4f56-ad46-30b3c5389018 req-a14e52ce-1fd8-4567-a8bc-033f8d7bb5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd8ae4b-9ee1-4ba9-830e-d1e721901938", "name": "network-vif-deleted", "tag": "77aa0f57-1061-4ceb-8c03-558b3b45583f"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:53.384334 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:16:53.384334 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:16:53.403061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-d2836845-60eb-4f56-ad46-30b3c5389018 req-a14e52ce-1fd8-4567-a8bc-033f8d7bb5e5 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:53.403757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-d2836845-60eb-4f56-ad46-30b3c5389018 req-a14e52ce-1fd8-4567-a8bc-033f8d7bb5e5 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:53.426899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-d2836845-60eb-4f56-ad46-30b3c5389018 req-a14e52ce-1fd8-4567-a8bc-033f8d7bb5e5 service nova] Creating event network-vif-deleted:77aa0f57-1061-4ceb-8c03-558b3b45583f for instance 0dd8ae4b-9ee1-4ba9-830e-d1e721901938 on hv-cinder-78626 Apr 14 16:16:53.432771 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-d2836845-60eb-4f56-ad46-30b3c5389018 req-a14e52ce-1fd8-4567-a8bc-033f8d7bb5e5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054758 Apr 14 16:16:53.436171 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 421/840] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:16:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:16:53.657567 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5b617940-3b74-4204-aef8-6659ce63b54a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:53.658654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5b617940-3b74-4204-aef8-6659ce63b54a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:53.667536 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5b617940-3b74-4204-aef8-6659ce63b54a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:53.668050 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5b617940-3b74-4204-aef8-6659ce63b54a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:53.668957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5b617940-3b74-4204-aef8-6659ce63b54a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:53.669480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5b617940-3b74-4204-aef8-6659ce63b54a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:53.796540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-06f3586a-c0f5-476a-893b-3ab0ec3c10e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:53.797405 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-06f3586a-c0f5-476a-893b-3ab0ec3c10e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:53.803453 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5b617940-3b74-4204-aef8-6659ce63b54a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 14 microversion: 2.20 time: 0.150200 Apr 14 16:16:53.804629 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 420/841] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:16:53 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:53.808147 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06f3586a-c0f5-476a-893b-3ab0ec3c10e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:53.808854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06f3586a-c0f5-476a-893b-3ab0ec3c10e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:53.809744 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06f3586a-c0f5-476a-893b-3ab0ec3c10e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:53.810239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06f3586a-c0f5-476a-893b-3ab0ec3c10e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:53.891282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06f3586a-c0f5-476a-893b-3ab0ec3c10e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:53.891789 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06f3586a-c0f5-476a-893b-3ab0ec3c10e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:53.892497 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-06f3586a-c0f5-476a-893b-3ab0ec3c10e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lazy-loading 'fault' on Instance uuid 0dd8ae4b-9ee1-4ba9-830e-d1e721901938 {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:16:54.011656 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-06f3586a-c0f5-476a-893b-3ab0ec3c10e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:16:54.021894 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-06f3586a-c0f5-476a-893b-3ab0ec3c10e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 200 len: 1326 microversion: 2.1 time: 0.230386 Apr 14 16:16:54.022835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 422/842] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:53 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 1326 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:54.817590 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b3968383-cb97-4328-89bb-163f62b2f43b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:54.818674 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b3968383-cb97-4328-89bb-163f62b2f43b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:54.827978 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b3968383-cb97-4328-89bb-163f62b2f43b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:54.828496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b3968383-cb97-4328-89bb-163f62b2f43b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:54.829367 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b3968383-cb97-4328-89bb-163f62b2f43b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:54.829859 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b3968383-cb97-4328-89bb-163f62b2f43b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:54.945514 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b3968383-cb97-4328-89bb-163f62b2f43b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 14 microversion: 2.20 time: 0.132290 Apr 14 16:16:54.947075 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 421/843] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:16:54 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:55.042277 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6a927155-700e-4d45-a34d-ac64e91285f8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:55.043069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6a927155-700e-4d45-a34d-ac64e91285f8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:55.052232 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a927155-700e-4d45-a34d-ac64e91285f8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:55.052834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a927155-700e-4d45-a34d-ac64e91285f8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:55.053937 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a927155-700e-4d45-a34d-ac64e91285f8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:55.054624 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a927155-700e-4d45-a34d-ac64e91285f8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:55.129932 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-6a927155-700e-4d45-a34d-ac64e91285f8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] HTTP exception thrown: Instance 0dd8ae4b-9ee1-4ba9-830e-d1e721901938 could not be found. Apr 14 16:16:55.130615 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6a927155-700e-4d45-a34d-ac64e91285f8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Returning 404 to user: Instance 0dd8ae4b-9ee1-4ba9-830e-d1e721901938 could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:16:55.131922 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6a927155-700e-4d45-a34d-ac64e91285f8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 404 len: 111 microversion: 2.1 time: 0.094204 Apr 14 16:16:55.132567 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 423/844] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:16:55 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:16:55.144127 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-52f2e6a6-91c5-4e3a-b54e-18708efe01af tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '.version_select at 0x7ff58ce0e6a8>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:16:55.180407 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-52f2e6a6-91c5-4e3a-b54e-18708efe01af tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-555153971" status: 202 len: 0 microversion: 2.1 time: 0.041487 Apr 14 16:16:55.185228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 422/845] 10.222.0.60 () {58 vars in 1208 bytes} [Wed Apr 14 16:16:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-555153971 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:16:55.960088 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2ddc716e-9dfc-4ab2-8f3f-b96ef16020ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:55.962885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2ddc716e-9dfc-4ab2-8f3f-b96ef16020ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:55.990548 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2ddc716e-9dfc-4ab2-8f3f-b96ef16020ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:55.991107 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2ddc716e-9dfc-4ab2-8f3f-b96ef16020ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:55.995641 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2ddc716e-9dfc-4ab2-8f3f-b96ef16020ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:55.997450 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2ddc716e-9dfc-4ab2-8f3f-b96ef16020ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:56.209464 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2ddc716e-9dfc-4ab2-8f3f-b96ef16020ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 14 microversion: 2.20 time: 0.254949 Apr 14 16:16:56.210147 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 424/846] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:16:55 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 14 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:56.689172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-050383d7-46b0-4944-8040-ea5a317060c8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'create', calling method: .version_select at 0x7ff58ce0e488>, body: {"keypair": {"name": "tempest-keypair-1137835968"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:56.716375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-050383d7-46b0-4944-8040-ea5a317060c8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Getting quotas for project 933c87bdb5354dc39f728c1bc6dfd17e. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:16:56.720808 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-050383d7-46b0-4944-8040-ea5a317060c8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Getting quotas for user 041bede4dd8e421c939c6fd868ac654e and project 933c87bdb5354dc39f728c1bc6dfd17e. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:16:57.023278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-050383d7-46b0-4944-8040-ea5a317060c8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Getting quotas for project 933c87bdb5354dc39f728c1bc6dfd17e. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:16:57.029195 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-050383d7-46b0-4944-8040-ea5a317060c8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Getting quotas for user 041bede4dd8e421c939c6fd868ac654e and project 933c87bdb5354dc39f728c1bc6dfd17e. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:16:57.044882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-050383d7-46b0-4944-8040-ea5a317060c8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.365228 Apr 14 16:16:57.045603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 423/847] 10.222.0.60 () {60 vars in 1148 bytes} [Wed Apr 14 16:16:56 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:57.222745 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-79051885-3a34-4417-b0b8-5f6de1d2e0e2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:57.223885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-79051885-3a34-4417-b0b8-5f6de1d2e0e2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:57.236424 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79051885-3a34-4417-b0b8-5f6de1d2e0e2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:57.237353 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79051885-3a34-4417-b0b8-5f6de1d2e0e2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:57.239813 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79051885-3a34-4417-b0b8-5f6de1d2e0e2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:57.240313 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79051885-3a34-4417-b0b8-5f6de1d2e0e2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:57.446707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-79051885-3a34-4417-b0b8-5f6de1d2e0e2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 14 microversion: 2.20 time: 0.227844 Apr 14 16:16:57.447892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 425/848] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:16:57 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 14 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:58.459339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-06a77b4e-cbb0-47e4-b660-7b4065e1708d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:58.460537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-06a77b4e-cbb0-47e4-b660-7b4065e1708d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:58.469480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06a77b4e-cbb0-47e4-b660-7b4065e1708d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:58.470006 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06a77b4e-cbb0-47e4-b660-7b4065e1708d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:58.470879 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06a77b4e-cbb0-47e4-b660-7b4065e1708d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:58.475828 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06a77b4e-cbb0-47e4-b660-7b4065e1708d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:58.660776 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-06a77b4e-cbb0-47e4-b660-7b4065e1708d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 14 microversion: 2.20 time: 0.205377 Apr 14 16:16:58.661534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 424/849] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:16:58 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:59.673485 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e88d4957-800d-47d1-bea9-1d273186ddcf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:59.679452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e88d4957-800d-47d1-bea9-1d273186ddcf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:16:59.689456 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e88d4957-800d-47d1-bea9-1d273186ddcf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:59.690325 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e88d4957-800d-47d1-bea9-1d273186ddcf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:59.691388 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e88d4957-800d-47d1-bea9-1d273186ddcf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:16:59.692096 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e88d4957-800d-47d1-bea9-1d273186ddcf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:16:59.823277 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e88d4957-800d-47d1-bea9-1d273186ddcf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 14 microversion: 2.20 time: 0.153265 Apr 14 16:16:59.826979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 426/850] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:16:59 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:00.324218 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1886825549", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5635013d-c232-42e6-92f8-9c466e9855da"}], "security_groups": [{"name": "tempest-securitygroup--1487042885"}], "key_name": "tempest-keypair-1137835968", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:00.483163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] validate_networks() for [('5635013d-c232-42e6-92f8-9c466e9855da', None, None, None)] {{(pid=99335) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:17:00.835763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2333f111-88e6-4a09-a91f-b7377f31e2ec tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:00.837950 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2333f111-88e6-4a09-a91f-b7377f31e2ec tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:00.846715 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2333f111-88e6-4a09-a91f-b7377f31e2ec tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:00.847296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2333f111-88e6-4a09-a91f-b7377f31e2ec tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:00.848212 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2333f111-88e6-4a09-a91f-b7377f31e2ec tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:00.848771 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2333f111-88e6-4a09-a91f-b7377f31e2ec tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:00.965903 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2333f111-88e6-4a09-a91f-b7377f31e2ec tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 867 microversion: 2.20 time: 0.134532 Apr 14 16:17:00.967325 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 427/851] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:00 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 867 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:17:01.113002 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Flavor limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:17:01.113506 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Image limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:17:01.114058 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Flavor pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:17:01.114526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Image pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:17:01.114997 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:17:01.124824 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:01.125507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:01.126397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:01.126901 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:01.146834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Getting quotas for project 933c87bdb5354dc39f728c1bc6dfd17e. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:17:01.153508 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Getting quotas for user 041bede4dd8e421c939c6fd868ac654e and project 933c87bdb5354dc39f728c1bc6dfd17e. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:17:01.172881 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Going to run 1 instances... {{(pid=99335) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:17:01.175614 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:17:01.230799 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3b894d74-4b74-460d-9c52-36d7634e5a72 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.914073 Apr 14 16:17:01.231696 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 425/852] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:17:00 2021] POST /compute/v2.1/servers => generated 402 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:17:01.243249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5ba2cdf7-b833-4b9d-b98a-bf5111103147 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:01.244026 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5ba2cdf7-b833-4b9d-b98a-bf5111103147 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:01.347331 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5ba2cdf7-b833-4b9d-b98a-bf5111103147 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:01.356266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5ba2cdf7-b833-4b9d-b98a-bf5111103147 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1238 microversion: 2.1 time: 0.117732 Apr 14 16:17:01.357124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 428/853] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:01 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1238 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:01.979015 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-dfb34772-0b28-4ba6-89ab-2b5864ffecdd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:01.980775 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-dfb34772-0b28-4ba6-89ab-2b5864ffecdd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:01.999345 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dfb34772-0b28-4ba6-89ab-2b5864ffecdd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:02.010722 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dfb34772-0b28-4ba6-89ab-2b5864ffecdd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:02.013938 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dfb34772-0b28-4ba6-89ab-2b5864ffecdd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:02.014930 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dfb34772-0b28-4ba6-89ab-2b5864ffecdd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:02.141618 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-dfb34772-0b28-4ba6-89ab-2b5864ffecdd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 7937 microversion: 2.20 time: 0.166811 Apr 14 16:17:02.142910 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 426/854] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:01 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 7937 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:17:02.379856 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-44c4d0bb-6696-4318-a8d0-6d17a68f711a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:02.380577 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-44c4d0bb-6696-4318-a8d0-6d17a68f711a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:02.395932 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44c4d0bb-6696-4318-a8d0-6d17a68f711a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:02.398168 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44c4d0bb-6696-4318-a8d0-6d17a68f711a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:02.399603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44c4d0bb-6696-4318-a8d0-6d17a68f711a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:02.400323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44c4d0bb-6696-4318-a8d0-6d17a68f711a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:02.602923 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-44c4d0bb-6696-4318-a8d0-6d17a68f711a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:02.619003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-44c4d0bb-6696-4318-a8d0-6d17a68f711a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1290 microversion: 2.1 time: 0.248185 Apr 14 16:17:02.627134 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 429/855] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:02 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1290 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:03.155981 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-68345203-79f6-4f27-9b8c-a199eca0f82d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:03.157485 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-68345203-79f6-4f27-9b8c-a199eca0f82d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:03.177213 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-68345203-79f6-4f27-9b8c-a199eca0f82d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:03.177724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-68345203-79f6-4f27-9b8c-a199eca0f82d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:03.178551 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-68345203-79f6-4f27-9b8c-a199eca0f82d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:03.186740 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-68345203-79f6-4f27-9b8c-a199eca0f82d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:03.370251 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-68345203-79f6-4f27-9b8c-a199eca0f82d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 12971 microversion: 2.20 time: 0.219271 Apr 14 16:17:03.370962 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 427/856] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:03 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 12971 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:03.639712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-60b93bb0-462d-4c66-b9f3-94f05e434623 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:03.640363 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-60b93bb0-462d-4c66-b9f3-94f05e434623 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:03.667705 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-60b93bb0-462d-4c66-b9f3-94f05e434623 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:03.668253 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-60b93bb0-462d-4c66-b9f3-94f05e434623 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:03.669211 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-60b93bb0-462d-4c66-b9f3-94f05e434623 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:03.669711 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-60b93bb0-462d-4c66-b9f3-94f05e434623 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:04.242182 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-60b93bb0-462d-4c66-b9f3-94f05e434623 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:04.262303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-60b93bb0-462d-4c66-b9f3-94f05e434623 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1364 microversion: 2.1 time: 0.626693 Apr 14 16:17:04.265060 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 430/857] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:03 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1364 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:04.382398 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c9f0cdde-bff1-4c5c-bfdf-9a3e2af46909 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:04.383796 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c9f0cdde-bff1-4c5c-bfdf-9a3e2af46909 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:04.403573 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9f0cdde-bff1-4c5c-bfdf-9a3e2af46909 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:04.404283 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9f0cdde-bff1-4c5c-bfdf-9a3e2af46909 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:04.405238 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9f0cdde-bff1-4c5c-bfdf-9a3e2af46909 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:04.405740 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c9f0cdde-bff1-4c5c-bfdf-9a3e2af46909 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:04.593667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c9f0cdde-bff1-4c5c-bfdf-9a3e2af46909 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 17931 microversion: 2.20 time: 0.215857 Apr 14 16:17:04.597641 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 428/858] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:04 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 17931 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:05.284254 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a63ad017-dad1-496c-84bf-610ab2383dc1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:05.284933 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a63ad017-dad1-496c-84bf-610ab2383dc1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:05.294119 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a63ad017-dad1-496c-84bf-610ab2383dc1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:05.294858 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a63ad017-dad1-496c-84bf-610ab2383dc1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:05.299037 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a63ad017-dad1-496c-84bf-610ab2383dc1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:05.299851 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a63ad017-dad1-496c-84bf-610ab2383dc1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:05.606641 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-73b2c475-2987-4850-8da5-5efef32dd244 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:05.607776 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-73b2c475-2987-4850-8da5-5efef32dd244 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:05.623442 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-73b2c475-2987-4850-8da5-5efef32dd244 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:05.630360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-73b2c475-2987-4850-8da5-5efef32dd244 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:05.631553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-73b2c475-2987-4850-8da5-5efef32dd244 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:05.632241 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-73b2c475-2987-4850-8da5-5efef32dd244 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:05.780734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-73b2c475-2987-4850-8da5-5efef32dd244 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 18083 microversion: 2.20 time: 0.178307 Apr 14 16:17:05.781629 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 429/859] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:05 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 18083 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:06.311629 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-5ce4966e-0727-410c-8160-060dddf77aa0 req-0d7b76fe-9431-43ef-b2ce-2acc067d1986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aec1638-2b51-4bc7-a664-e2d1b227228f", "tag": "f1caa616-44ca-499b-9670-8b92cff097ae"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:06.313509 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:17:06.313509 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:17:06.335794 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-5ce4966e-0727-410c-8160-060dddf77aa0 req-0d7b76fe-9431-43ef-b2ce-2acc067d1986 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:06.347296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-5ce4966e-0727-410c-8160-060dddf77aa0 req-0d7b76fe-9431-43ef-b2ce-2acc067d1986 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:06.370213 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-5ce4966e-0727-410c-8160-060dddf77aa0 req-0d7b76fe-9431-43ef-b2ce-2acc067d1986 service nova] Creating event network-changed:f1caa616-44ca-499b-9670-8b92cff097ae for instance 8aec1638-2b51-4bc7-a664-e2d1b227228f on hv-cinder-78626 Apr 14 16:17:06.379959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-5ce4966e-0727-410c-8160-060dddf77aa0 req-0d7b76fe-9431-43ef-b2ce-2acc067d1986 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073343 Apr 14 16:17:06.380995 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 430/860] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:17:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:17:06.396944 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b5b2be07-6440-4a84-9f22-457942dfa108 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43217caf-e2a6-4c94-a89c-d32f65cddc23", "device": "/dev/sdb"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:06.400236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b5b2be07-6440-4a84-9f22-457942dfa108 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:06.421870 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5b2be07-6440-4a84-9f22-457942dfa108 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:06.428171 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5b2be07-6440-4a84-9f22-457942dfa108 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:06.429382 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5b2be07-6440-4a84-9f22-457942dfa108 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:06.430601 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5b2be07-6440-4a84-9f22-457942dfa108 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:06.603693 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a63ad017-dad1-496c-84bf-610ab2383dc1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:06.620066 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a63ad017-dad1-496c-84bf-610ab2383dc1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1364 microversion: 2.1 time: 1.333906 Apr 14 16:17:06.630171 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 431/861] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:05 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1364 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:06.794333 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-63b5955e-411f-4233-90cd-a4921334db94 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:06.795620 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-63b5955e-411f-4233-90cd-a4921334db94 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:06.817825 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-63b5955e-411f-4233-90cd-a4921334db94 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:06.818587 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-63b5955e-411f-4233-90cd-a4921334db94 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:06.819659 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-63b5955e-411f-4233-90cd-a4921334db94 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:06.820421 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-63b5955e-411f-4233-90cd-a4921334db94 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:06.960803 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-63b5955e-411f-4233-90cd-a4921334db94 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 20997 microversion: 2.20 time: 0.172520 Apr 14 16:17:06.962435 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 432/862] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:06 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 20997 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:07.010557 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b5b2be07-6440-4a84-9f22-457942dfa108 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "POST /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.627404 Apr 14 16:17:07.011834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 431/863] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Apr 14 16:17:06 2021] POST /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7/os-volume_attachments => generated 194 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:17:07.639361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2761abc0-a986-4000-ac7d-26eb3245f96c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:07.640132 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2761abc0-a986-4000-ac7d-26eb3245f96c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:07.650139 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2761abc0-a986-4000-ac7d-26eb3245f96c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:07.651081 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2761abc0-a986-4000-ac7d-26eb3245f96c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:07.652745 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2761abc0-a986-4000-ac7d-26eb3245f96c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:07.654522 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2761abc0-a986-4000-ac7d-26eb3245f96c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:07.990316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bf02bf12-366a-41e5-9884-65fb4955d601 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:07.994562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bf02bf12-366a-41e5-9884-65fb4955d601 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:08.013101 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2761abc0-a986-4000-ac7d-26eb3245f96c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:08.019482 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bf02bf12-366a-41e5-9884-65fb4955d601 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:08.022505 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bf02bf12-366a-41e5-9884-65fb4955d601 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:08.025328 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2761abc0-a986-4000-ac7d-26eb3245f96c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1364 microversion: 2.1 time: 0.390345 Apr 14 16:17:08.027010 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bf02bf12-366a-41e5-9884-65fb4955d601 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:08.027632 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 433/864] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:07 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1364 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:17:08.028630 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bf02bf12-366a-41e5-9884-65fb4955d601 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:08.201931 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bf02bf12-366a-41e5-9884-65fb4955d601 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 22546 microversion: 2.20 time: 0.231278 Apr 14 16:17:08.203002 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 432/865] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:07 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 22546 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:09.044846 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6f870553-bb7b-4f1e-8891-4886f17d1a87 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:09.046309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6f870553-bb7b-4f1e-8891-4886f17d1a87 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:09.055947 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f870553-bb7b-4f1e-8891-4886f17d1a87 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:09.056542 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f870553-bb7b-4f1e-8891-4886f17d1a87 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:09.057438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f870553-bb7b-4f1e-8891-4886f17d1a87 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:09.057940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f870553-bb7b-4f1e-8891-4886f17d1a87 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:09.215117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-75e2e93b-3554-4ad2-a374-f13394212a95 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:09.216677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-75e2e93b-3554-4ad2-a374-f13394212a95 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:09.227962 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-75e2e93b-3554-4ad2-a374-f13394212a95 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:09.228479 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-75e2e93b-3554-4ad2-a374-f13394212a95 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:09.229542 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-75e2e93b-3554-4ad2-a374-f13394212a95 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:09.230425 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-75e2e93b-3554-4ad2-a374-f13394212a95 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:09.360371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-75e2e93b-3554-4ad2-a374-f13394212a95 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 23802 microversion: 2.20 time: 0.149734 Apr 14 16:17:09.363035 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 433/866] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:09 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 23802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:09.725940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6f870553-bb7b-4f1e-8891-4886f17d1a87 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:09.736494 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6f870553-bb7b-4f1e-8891-4886f17d1a87 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1364 microversion: 2.1 time: 0.696068 Apr 14 16:17:09.737349 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 434/867] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:09 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1364 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:10.139169 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-eb45295a-6e23-453d-b655-7bc71f9e2ead tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Action: 'create', calling method: .version_select at 0x7ff58e047620>, body: {"keypair": {"name": "tempest-TestShelveInstance-938127160"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:10.170058 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-eb45295a-6e23-453d-b655-7bc71f9e2ead tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Getting quotas for project 6afd00d65090450fa9559d0d5ef3a252. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:17:10.175546 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-eb45295a-6e23-453d-b655-7bc71f9e2ead tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Getting quotas for user e97db130f1f0412ab3a13ded5c7b7e01 and project 6afd00d65090450fa9559d0d5ef3a252. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:17:10.372857 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-74df30b7-44d8-48dc-8044-29c40ba4a554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:10.373992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-74df30b7-44d8-48dc-8044-29c40ba4a554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:10.382115 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-74df30b7-44d8-48dc-8044-29c40ba4a554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:10.383263 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-74df30b7-44d8-48dc-8044-29c40ba4a554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:10.384322 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-74df30b7-44d8-48dc-8044-29c40ba4a554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:10.384922 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-74df30b7-44d8-48dc-8044-29c40ba4a554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:10.435014 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-eb45295a-6e23-453d-b655-7bc71f9e2ead tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Getting quotas for project 6afd00d65090450fa9559d0d5ef3a252. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:17:10.439504 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-eb45295a-6e23-453d-b655-7bc71f9e2ead tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Getting quotas for user e97db130f1f0412ab3a13ded5c7b7e01 and project 6afd00d65090450fa9559d0d5ef3a252. Resources: {'key_pairs'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:17:10.455237 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-eb45295a-6e23-453d-b655-7bc71f9e2ead tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.514796 Apr 14 16:17:10.455915 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 434/868] 10.222.0.60 () {60 vars in 1148 bytes} [Wed Apr 14 16:17:09 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:17:10.499631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-74df30b7-44d8-48dc-8044-29c40ba4a554 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 24817 microversion: 2.20 time: 0.130588 Apr 14 16:17:10.500613 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 435/869] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:10 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 24817 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:10.754887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0fdb21ab-c7cb-48d7-b897-88b5bdde5091 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:10.755626 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0fdb21ab-c7cb-48d7-b897-88b5bdde5091 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:10.765334 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fdb21ab-c7cb-48d7-b897-88b5bdde5091 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:10.765856 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fdb21ab-c7cb-48d7-b897-88b5bdde5091 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:10.766730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fdb21ab-c7cb-48d7-b897-88b5bdde5091 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:10.767230 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0fdb21ab-c7cb-48d7-b897-88b5bdde5091 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:11.043167 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0fdb21ab-c7cb-48d7-b897-88b5bdde5091 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:11.052242 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0fdb21ab-c7cb-48d7-b897-88b5bdde5091 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1364 microversion: 2.1 time: 0.301455 Apr 14 16:17:11.052906 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 435/870] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:10 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1364 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:11.513090 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-66f05a3c-1ff5-4239-aa03-099395c04e89 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:11.514242 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-66f05a3c-1ff5-4239-aa03-099395c04e89 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:11.522683 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-66f05a3c-1ff5-4239-aa03-099395c04e89 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:11.523454 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-66f05a3c-1ff5-4239-aa03-099395c04e89 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:11.524307 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-66f05a3c-1ff5-4239-aa03-099395c04e89 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:11.524794 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-66f05a3c-1ff5-4239-aa03-099395c04e89 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:11.642055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-66f05a3c-1ff5-4239-aa03-099395c04e89 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 25877 microversion: 2.20 time: 0.133240 Apr 14 16:17:11.643650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 436/871] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:11 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 25877 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:12.072303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-24b45fc8-80e7-4671-86b2-1e786bf14c31 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:12.072977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-24b45fc8-80e7-4671-86b2-1e786bf14c31 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:12.082167 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-24b45fc8-80e7-4671-86b2-1e786bf14c31 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:12.082656 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-24b45fc8-80e7-4671-86b2-1e786bf14c31 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:12.083657 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-24b45fc8-80e7-4671-86b2-1e786bf14c31 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:12.084280 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-24b45fc8-80e7-4671-86b2-1e786bf14c31 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:12.310532 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-24b45fc8-80e7-4671-86b2-1e786bf14c31 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:12.319311 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-24b45fc8-80e7-4671-86b2-1e786bf14c31 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1364 microversion: 2.1 time: 0.251979 Apr 14 16:17:12.319965 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 436/872] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:12 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1364 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:12.655939 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c5fca24a-d2a8-4ef8-a484-ad97bf48a555 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:12.657482 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c5fca24a-d2a8-4ef8-a484-ad97bf48a555 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:12.667201 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5fca24a-d2a8-4ef8-a484-ad97bf48a555 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:12.667575 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5fca24a-d2a8-4ef8-a484-ad97bf48a555 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:12.668387 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5fca24a-d2a8-4ef8-a484-ad97bf48a555 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:12.668872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c5fca24a-d2a8-4ef8-a484-ad97bf48a555 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:12.782484 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c5fca24a-d2a8-4ef8-a484-ad97bf48a555 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 26958 microversion: 2.20 time: 0.130668 Apr 14 16:17:12.787382 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 437/873] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:12 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 26958 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:13.349449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-43dcfbf2-301c-40b5-b761-698845d2759f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:13.357627 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-43dcfbf2-301c-40b5-b761-698845d2759f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:13.374131 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43dcfbf2-301c-40b5-b761-698845d2759f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:13.374642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43dcfbf2-301c-40b5-b761-698845d2759f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:13.375669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43dcfbf2-301c-40b5-b761-698845d2759f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:13.376352 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-43dcfbf2-301c-40b5-b761-698845d2759f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:13.466258 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-f61d731b-8e60-4329-97da-3263024c1578 req-b50a0b20-c942-42c5-99f8-2329b5da6e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aec1638-2b51-4bc7-a664-e2d1b227228f", "name": "network-vif-plugged", "status": "completed", "tag": "f1caa616-44ca-499b-9670-8b92cff097ae"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:13.468065 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:17:13.468065 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:17:13.494815 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-f61d731b-8e60-4329-97da-3263024c1578 req-b50a0b20-c942-42c5-99f8-2329b5da6e5c service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:13.500588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-f61d731b-8e60-4329-97da-3263024c1578 req-b50a0b20-c942-42c5-99f8-2329b5da6e5c service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:13.549745 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-f61d731b-8e60-4329-97da-3263024c1578 req-b50a0b20-c942-42c5-99f8-2329b5da6e5c service nova] Creating event network-vif-plugged:f1caa616-44ca-499b-9670-8b92cff097ae for instance 8aec1638-2b51-4bc7-a664-e2d1b227228f on hv-cinder-78626 Apr 14 16:17:13.556816 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-f61d731b-8e60-4329-97da-3263024c1578 req-b50a0b20-c942-42c5-99f8-2329b5da6e5c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097570 Apr 14 16:17:13.568505 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 438/874] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:17:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:17:13.639610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-43dcfbf2-301c-40b5-b761-698845d2759f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:13.649622 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-43dcfbf2-301c-40b5-b761-698845d2759f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1364 microversion: 2.1 time: 0.308832 Apr 14 16:17:13.650086 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 437/875] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:13 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1364 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:13.796706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2136bf41-137a-43f8-9a9e-65a49878debf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:13.798631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2136bf41-137a-43f8-9a9e-65a49878debf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:13.809686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2136bf41-137a-43f8-9a9e-65a49878debf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:13.810204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2136bf41-137a-43f8-9a9e-65a49878debf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:13.811066 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2136bf41-137a-43f8-9a9e-65a49878debf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:13.811562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2136bf41-137a-43f8-9a9e-65a49878debf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:14.003990 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2136bf41-137a-43f8-9a9e-65a49878debf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 27453 microversion: 2.20 time: 0.211927 Apr 14 16:17:14.005105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 439/876] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:13 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 27453 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:14.668823 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-277be356-ee6d-4033-8a5d-a73de9a76330 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:14.669834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-277be356-ee6d-4033-8a5d-a73de9a76330 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:14.678801 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-277be356-ee6d-4033-8a5d-a73de9a76330 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:14.679887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-277be356-ee6d-4033-8a5d-a73de9a76330 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:14.681494 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-277be356-ee6d-4033-8a5d-a73de9a76330 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:14.682204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-277be356-ee6d-4033-8a5d-a73de9a76330 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:14.894714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-277be356-ee6d-4033-8a5d-a73de9a76330 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:14.903582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-277be356-ee6d-4033-8a5d-a73de9a76330 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1364 microversion: 2.1 time: 0.239475 Apr 14 16:17:14.904566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 438/877] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:14 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:15.017763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-528e3d4f-df7c-4ebf-a266-95085c8d2f7b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:15.018901 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-528e3d4f-df7c-4ebf-a266-95085c8d2f7b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:15.034392 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-528e3d4f-df7c-4ebf-a266-95085c8d2f7b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:15.034899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-528e3d4f-df7c-4ebf-a266-95085c8d2f7b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:15.036015 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-528e3d4f-df7c-4ebf-a266-95085c8d2f7b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:15.036504 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-528e3d4f-df7c-4ebf-a266-95085c8d2f7b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:15.200578 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-528e3d4f-df7c-4ebf-a266-95085c8d2f7b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 27691 microversion: 2.20 time: 0.187071 Apr 14 16:17:15.201314 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 440/878] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:15 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 27691 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:15.922789 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0770093f-a303-445e-beca-91cbd51e3d43 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:15.923456 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0770093f-a303-445e-beca-91cbd51e3d43 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:15.932677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0770093f-a303-445e-beca-91cbd51e3d43 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:15.933211 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0770093f-a303-445e-beca-91cbd51e3d43 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:15.934069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0770093f-a303-445e-beca-91cbd51e3d43 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:15.934545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0770093f-a303-445e-beca-91cbd51e3d43 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:16.156254 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0770093f-a303-445e-beca-91cbd51e3d43 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:16.167290 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0770093f-a303-445e-beca-91cbd51e3d43 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1550 microversion: 2.1 time: 0.248547 Apr 14 16:17:16.168177 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 439/879] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:15 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1550 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:16.186910 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d98b7d57-f4c3-43e8-b319-40bdd19876d7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:16.187577 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d98b7d57-f4c3-43e8-b319-40bdd19876d7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:16.197600 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d98b7d57-f4c3-43e8-b319-40bdd19876d7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:16.198350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d98b7d57-f4c3-43e8-b319-40bdd19876d7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:16.199428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d98b7d57-f4c3-43e8-b319-40bdd19876d7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:16.199914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d98b7d57-f4c3-43e8-b319-40bdd19876d7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:16.213827 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-679fabee-9cf3-4a1d-a50e-e0eeb81241e6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:16.215452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-679fabee-9cf3-4a1d-a50e-e0eeb81241e6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:16.225238 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-679fabee-9cf3-4a1d-a50e-e0eeb81241e6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:16.226105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-679fabee-9cf3-4a1d-a50e-e0eeb81241e6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:16.228017 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-679fabee-9cf3-4a1d-a50e-e0eeb81241e6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:16.228662 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-679fabee-9cf3-4a1d-a50e-e0eeb81241e6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:16.399806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d98b7d57-f4c3-43e8-b319-40bdd19876d7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.217463 Apr 14 16:17:16.400472 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 441/880] 10.222.0.60 () {58 vars in 1265 bytes} [Wed Apr 14 16:17:16 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:17:18.015388 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5b9f57cf-0a02-4321-9bdd-fa2a4377c59d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:18.016431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5b9f57cf-0a02-4321-9bdd-fa2a4377c59d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:18.031773 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5b9f57cf-0a02-4321-9bdd-fa2a4377c59d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:18.032806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5b9f57cf-0a02-4321-9bdd-fa2a4377c59d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:18.033842 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5b9f57cf-0a02-4321-9bdd-fa2a4377c59d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:18.034490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5b9f57cf-0a02-4321-9bdd-fa2a4377c59d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:19.537097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-679fabee-9cf3-4a1d-a50e-e0eeb81241e6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 28220 microversion: 2.20 time: 3.328392 Apr 14 16:17:19.542207 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 440/881] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:16 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 28220 bytes in 3330 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:19.543046 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5b9f57cf-0a02-4321-9bdd-fa2a4377c59d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 14 microversion: 2.1 time: 1.531784 Apr 14 16:17:19.543817 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 442/882] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:18 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 14 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 14 16:17:19.544529 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-d0d06062-577e-48f2-a7b4-b6d94bd53897 req-6a25059f-704b-402b-981f-db499b9b9b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aec1638-2b51-4bc7-a664-e2d1b227228f", "tag": "f1caa616-44ca-499b-9670-8b92cff097ae"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:19.546235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:17:19.546235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:17:19.555673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-d0d06062-577e-48f2-a7b4-b6d94bd53897 req-6a25059f-704b-402b-981f-db499b9b9b6e service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:19.556167 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-d0d06062-577e-48f2-a7b4-b6d94bd53897 req-6a25059f-704b-402b-981f-db499b9b9b6e service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:19.573370 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-d0d06062-577e-48f2-a7b4-b6d94bd53897 req-6a25059f-704b-402b-981f-db499b9b9b6e service nova] Creating event network-changed:f1caa616-44ca-499b-9670-8b92cff097ae for instance 8aec1638-2b51-4bc7-a664-e2d1b227228f on hv-cinder-78626 Apr 14 16:17:19.578597 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-d0d06062-577e-48f2-a7b4-b6d94bd53897 req-6a25059f-704b-402b-981f-db499b9b9b6e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039307 Apr 14 16:17:19.579231 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 441/883] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:17:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:17:20.551635 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6f5c684a-1991-42c4-9168-ff544fcd64f2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:20.552879 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6f5c684a-1991-42c4-9168-ff544fcd64f2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:20.557670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-25c5aaac-aa20-4bdf-98ab-53f46b43047a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:20.559080 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-25c5aaac-aa20-4bdf-98ab-53f46b43047a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:20.562768 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f5c684a-1991-42c4-9168-ff544fcd64f2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:20.563493 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f5c684a-1991-42c4-9168-ff544fcd64f2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:20.564121 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f5c684a-1991-42c4-9168-ff544fcd64f2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:20.564606 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f5c684a-1991-42c4-9168-ff544fcd64f2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:20.568934 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25c5aaac-aa20-4bdf-98ab-53f46b43047a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:20.568934 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25c5aaac-aa20-4bdf-98ab-53f46b43047a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:20.570252 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25c5aaac-aa20-4bdf-98ab-53f46b43047a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:20.570252 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25c5aaac-aa20-4bdf-98ab-53f46b43047a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:20.707491 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6f5c684a-1991-42c4-9168-ff544fcd64f2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 28220 microversion: 2.20 time: 0.160244 Apr 14 16:17:20.712145 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 443/884] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:20 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 28220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:20.719961 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-25c5aaac-aa20-4bdf-98ab-53f46b43047a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 14 microversion: 2.1 time: 0.168688 Apr 14 16:17:20.723433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 442/885] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:20 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 14 16:17:21.721283 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-663c1ff0-6609-40ec-ab84-e09b6de58b28 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:21.722437 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-663c1ff0-6609-40ec-ab84-e09b6de58b28 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:21.731590 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-663c1ff0-6609-40ec-ab84-e09b6de58b28 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:21.732092 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-663c1ff0-6609-40ec-ab84-e09b6de58b28 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:21.732224 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-dccf9285-58a3-43b6-a013-5fe43fdb1857 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:21.732932 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-663c1ff0-6609-40ec-ab84-e09b6de58b28 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:21.733337 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-dccf9285-58a3-43b6-a013-5fe43fdb1857 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:21.733475 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-663c1ff0-6609-40ec-ab84-e09b6de58b28 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:21.742405 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dccf9285-58a3-43b6-a013-5fe43fdb1857 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:21.743042 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dccf9285-58a3-43b6-a013-5fe43fdb1857 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:21.743893 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dccf9285-58a3-43b6-a013-5fe43fdb1857 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:21.744388 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dccf9285-58a3-43b6-a013-5fe43fdb1857 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:24.796350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-663c1ff0-6609-40ec-ab84-e09b6de58b28 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 28220 microversion: 2.20 time: 3.079474 Apr 14 16:17:24.797099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 444/886] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:21 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 28220 bytes in 3082 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:17:24.815507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-dccf9285-58a3-43b6-a013-5fe43fdb1857 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 14 microversion: 2.1 time: 3.087598 Apr 14 16:17:24.816196 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 443/887] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:21 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 14 bytes in 3090 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 14 16:17:25.809795 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6467e6fb-7653-4404-bc49-b7b7738d2ba7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:25.810942 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6467e6fb-7653-4404-bc49-b7b7738d2ba7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:25.819567 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6467e6fb-7653-4404-bc49-b7b7738d2ba7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:25.820175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6467e6fb-7653-4404-bc49-b7b7738d2ba7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:25.821241 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6467e6fb-7653-4404-bc49-b7b7738d2ba7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:25.821751 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6467e6fb-7653-4404-bc49-b7b7738d2ba7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:25.827882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9f2cb3c2-0954-45ca-9031-65f900f1531f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:25.829050 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9f2cb3c2-0954-45ca-9031-65f900f1531f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:25.837916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9f2cb3c2-0954-45ca-9031-65f900f1531f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:25.838432 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9f2cb3c2-0954-45ca-9031-65f900f1531f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:25.839277 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9f2cb3c2-0954-45ca-9031-65f900f1531f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:25.839777 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9f2cb3c2-0954-45ca-9031-65f900f1531f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:25.944052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6467e6fb-7653-4404-bc49-b7b7738d2ba7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 28220 microversion: 2.20 time: 0.139396 Apr 14 16:17:25.944694 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 445/888] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:25 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 28220 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:25.959356 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9f2cb3c2-0954-45ca-9031-65f900f1531f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 14 microversion: 2.1 time: 0.135881 Apr 14 16:17:25.960048 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 444/889] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:25 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:17:26.957282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-df3f12b4-c49d-4343-ad59-77df15226e16 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:26.958435 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-df3f12b4-c49d-4343-ad59-77df15226e16 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:26.967229 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df3f12b4-c49d-4343-ad59-77df15226e16 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:26.967742 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df3f12b4-c49d-4343-ad59-77df15226e16 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:26.968586 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df3f12b4-c49d-4343-ad59-77df15226e16 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:26.969106 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df3f12b4-c49d-4343-ad59-77df15226e16 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:26.972149 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6a18a853-324e-4fd3-9701-20ea61f60877 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:26.973423 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6a18a853-324e-4fd3-9701-20ea61f60877 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:26.982241 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a18a853-324e-4fd3-9701-20ea61f60877 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:26.982752 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a18a853-324e-4fd3-9701-20ea61f60877 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:26.983588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a18a853-324e-4fd3-9701-20ea61f60877 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:26.984082 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a18a853-324e-4fd3-9701-20ea61f60877 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:30.492445 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-df3f12b4-c49d-4343-ad59-77df15226e16 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 28510 microversion: 2.20 time: 3.539530 Apr 14 16:17:30.493178 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 446/890] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:26 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 28510 bytes in 3542 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:30.500927 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6a18a853-324e-4fd3-9701-20ea61f60877 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 14 microversion: 2.1 time: 3.533320 Apr 14 16:17:30.501672 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 445/891] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:26 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 14 bytes in 3535 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 14 16:17:31.505430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3ffd4b4e-a49e-464a-b152-2f7f31907bb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:31.506620 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3ffd4b4e-a49e-464a-b152-2f7f31907bb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:31.512848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-45c0212b-8e85-42f4-9e7d-2048eb0d94fb tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:31.514037 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-45c0212b-8e85-42f4-9e7d-2048eb0d94fb tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:31.515434 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3ffd4b4e-a49e-464a-b152-2f7f31907bb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:31.515948 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3ffd4b4e-a49e-464a-b152-2f7f31907bb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:31.516791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3ffd4b4e-a49e-464a-b152-2f7f31907bb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:31.517306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3ffd4b4e-a49e-464a-b152-2f7f31907bb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:31.522647 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45c0212b-8e85-42f4-9e7d-2048eb0d94fb tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:31.523165 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45c0212b-8e85-42f4-9e7d-2048eb0d94fb tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:31.524561 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45c0212b-8e85-42f4-9e7d-2048eb0d94fb tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:31.525168 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45c0212b-8e85-42f4-9e7d-2048eb0d94fb tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:31.645478 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3ffd4b4e-a49e-464a-b152-2f7f31907bb3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 28510 microversion: 2.20 time: 0.144448 Apr 14 16:17:31.646189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 447/892] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:31 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 28510 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:31.661987 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-45c0212b-8e85-42f4-9e7d-2048eb0d94fb tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 14 microversion: 2.1 time: 0.153434 Apr 14 16:17:31.662771 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 446/893] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:31 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 14 16:17:32.659876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cd42b6b3-c873-4bd7-a37b-28dff5d94c58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:32.660976 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cd42b6b3-c873-4bd7-a37b-28dff5d94c58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:32.669863 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd42b6b3-c873-4bd7-a37b-28dff5d94c58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:32.670365 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd42b6b3-c873-4bd7-a37b-28dff5d94c58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:32.671197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd42b6b3-c873-4bd7-a37b-28dff5d94c58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:32.671684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd42b6b3-c873-4bd7-a37b-28dff5d94c58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:32.674960 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1db23c30-a3eb-4add-a945-b204e24be038 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:32.676154 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1db23c30-a3eb-4add-a945-b204e24be038 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:32.685203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1db23c30-a3eb-4add-a945-b204e24be038 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:32.685720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1db23c30-a3eb-4add-a945-b204e24be038 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:32.686566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1db23c30-a3eb-4add-a945-b204e24be038 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:32.687059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1db23c30-a3eb-4add-a945-b204e24be038 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:32.789509 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cd42b6b3-c873-4bd7-a37b-28dff5d94c58 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 28774 microversion: 2.20 time: 0.134344 Apr 14 16:17:32.790459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 448/894] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:32 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 28774 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:32.806887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1db23c30-a3eb-4add-a945-b204e24be038 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 14 microversion: 2.1 time: 0.136262 Apr 14 16:17:32.807558 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 447/895] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:32 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:17:33.802692 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-da25adf7-ef76-4894-828d-8a02487a7ce3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:33.803840 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-da25adf7-ef76-4894-828d-8a02487a7ce3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:33.812487 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da25adf7-ef76-4894-828d-8a02487a7ce3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:33.812986 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da25adf7-ef76-4894-828d-8a02487a7ce3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:33.813840 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da25adf7-ef76-4894-828d-8a02487a7ce3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:33.814331 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da25adf7-ef76-4894-828d-8a02487a7ce3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:33.819027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ab3bcda3-0dec-4097-ace0-0a4701764af4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:33.820161 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ab3bcda3-0dec-4097-ace0-0a4701764af4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:33.828720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ab3bcda3-0dec-4097-ace0-0a4701764af4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:33.829284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ab3bcda3-0dec-4097-ace0-0a4701764af4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:33.830112 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ab3bcda3-0dec-4097-ace0-0a4701764af4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:33.830605 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ab3bcda3-0dec-4097-ace0-0a4701764af4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:33.936967 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-da25adf7-ef76-4894-828d-8a02487a7ce3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 28774 microversion: 2.20 time: 0.138606 Apr 14 16:17:33.937739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 449/896] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:33 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 28774 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:33.943980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ab3bcda3-0dec-4097-ace0-0a4701764af4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 14 microversion: 2.1 time: 0.129257 Apr 14 16:17:33.944725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 448/897] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:33 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:17:34.949435 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c48c1f3b-4c8f-4233-aaf8-0f04ff4866dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:34.950601 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c48c1f3b-4c8f-4233-aaf8-0f04ff4866dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:34.956258 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-98c1fdd0-b4fa-4e8d-888a-30f0a53f73c0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:34.957439 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-98c1fdd0-b4fa-4e8d-888a-30f0a53f73c0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:34.958966 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c48c1f3b-4c8f-4233-aaf8-0f04ff4866dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:34.959481 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c48c1f3b-4c8f-4233-aaf8-0f04ff4866dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:34.960338 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c48c1f3b-4c8f-4233-aaf8-0f04ff4866dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:34.960832 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c48c1f3b-4c8f-4233-aaf8-0f04ff4866dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:34.966168 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-98c1fdd0-b4fa-4e8d-888a-30f0a53f73c0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:34.966674 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-98c1fdd0-b4fa-4e8d-888a-30f0a53f73c0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:34.967506 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-98c1fdd0-b4fa-4e8d-888a-30f0a53f73c0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:34.967996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-98c1fdd0-b4fa-4e8d-888a-30f0a53f73c0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:35.109122 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-98c1fdd0-b4fa-4e8d-888a-30f0a53f73c0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 5221 microversion: 2.1 time: 0.157108 Apr 14 16:17:35.112844 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 449/898] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:34 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 5221 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:17:35.118855 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c48c1f3b-4c8f-4233-aaf8-0f04ff4866dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 28774 microversion: 2.20 time: 0.173755 Apr 14 16:17:35.120465 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 450/899] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:34 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 28774 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:35.255258 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-eb82d44d-7ee8-49a1-9bd5-6d170974fa0b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:35.255918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-eb82d44d-7ee8-49a1-9bd5-6d170974fa0b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:35.264520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb82d44d-7ee8-49a1-9bd5-6d170974fa0b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:35.265030 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb82d44d-7ee8-49a1-9bd5-6d170974fa0b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:35.265908 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb82d44d-7ee8-49a1-9bd5-6d170974fa0b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:35.266401 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb82d44d-7ee8-49a1-9bd5-6d170974fa0b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:35.444371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-eb82d44d-7ee8-49a1-9bd5-6d170974fa0b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lazy-loading 'services' on Instance uuid 6c19596f-1b41-4441-aac8-f715ca5e16d7 {{(pid=99335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:17:35.588296 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-eb82d44d-7ee8-49a1-9bd5-6d170974fa0b tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7/os-volume_attachments/43217caf-e2a6-4c94-a89c-d32f65cddc23" status: 202 len: 0 microversion: 2.1 time: 0.337499 Apr 14 16:17:35.589256 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 450/900] 10.222.0.60 () {58 vars in 1406 bytes} [Wed Apr 14 16:17:35 2021] DELETE /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7/os-volume_attachments/43217caf-e2a6-4c94-a89c-d32f65cddc23 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:35.725627 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0d4e3e77-c068-443d-9d94-19e632e35d10 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:35.726278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0d4e3e77-c068-443d-9d94-19e632e35d10 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:35.734976 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d4e3e77-c068-443d-9d94-19e632e35d10 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:35.735480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d4e3e77-c068-443d-9d94-19e632e35d10 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:35.736312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d4e3e77-c068-443d-9d94-19e632e35d10 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:35.736797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d4e3e77-c068-443d-9d94-19e632e35d10 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:35.802566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0d4e3e77-c068-443d-9d94-19e632e35d10 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Going to try to terminate instance {{(pid=99334) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:17:35.917185 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0d4e3e77-c068-443d-9d94-19e632e35d10 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 204 len: 0 microversion: 2.1 time: 0.195873 Apr 14 16:17:35.918026 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 451/901] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:17:35 2021] DELETE /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:17:35.927167 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-242c2c2e-066b-4b63-a1de-e22acf78a05a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:35.927943 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-242c2c2e-066b-4b63-a1de-e22acf78a05a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:35.936490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-242c2c2e-066b-4b63-a1de-e22acf78a05a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:35.937003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-242c2c2e-066b-4b63-a1de-e22acf78a05a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:35.937899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-242c2c2e-066b-4b63-a1de-e22acf78a05a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:35.938401 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-242c2c2e-066b-4b63-a1de-e22acf78a05a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:36.122661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-20d58e44-fade-4f0c-9be2-7bee31de5229 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:36.123882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-20d58e44-fade-4f0c-9be2-7bee31de5229 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:36.132263 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20d58e44-fade-4f0c-9be2-7bee31de5229 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:36.132767 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20d58e44-fade-4f0c-9be2-7bee31de5229 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:36.134373 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20d58e44-fade-4f0c-9be2-7bee31de5229 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:36.134868 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20d58e44-fade-4f0c-9be2-7bee31de5229 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:36.144079 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-242c2c2e-066b-4b63-a1de-e22acf78a05a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:36.153138 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-242c2c2e-066b-4b63-a1de-e22acf78a05a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1576 microversion: 2.1 time: 0.230456 Apr 14 16:17:36.153763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 451/902] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:35 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:36.158757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-45f0d8b2-41c5-4dc4-9f38-5e2858eff88b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:36.159855 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-45f0d8b2-41c5-4dc4-9f38-5e2858eff88b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:36.167337 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45f0d8b2-41c5-4dc4-9f38-5e2858eff88b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:36.167839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45f0d8b2-41c5-4dc4-9f38-5e2858eff88b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:36.168660 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45f0d8b2-41c5-4dc4-9f38-5e2858eff88b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:36.169203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45f0d8b2-41c5-4dc4-9f38-5e2858eff88b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:36.267233 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-20d58e44-fade-4f0c-9be2-7bee31de5229 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 9302 microversion: 2.1 time: 0.150392 Apr 14 16:17:36.268158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 452/903] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:36 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 9302 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:17:36.319112 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-45f0d8b2-41c5-4dc4-9f38-5e2858eff88b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 28774 microversion: 2.20 time: 0.163921 Apr 14 16:17:36.319829 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 452/904] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:36 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 28774 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:37.173234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-190f5505-f6f9-4242-8b24-e3d699a195d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:37.174010 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-190f5505-f6f9-4242-8b24-e3d699a195d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:37.182332 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-190f5505-f6f9-4242-8b24-e3d699a195d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:37.182840 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-190f5505-f6f9-4242-8b24-e3d699a195d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:37.183682 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-190f5505-f6f9-4242-8b24-e3d699a195d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:37.184180 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-190f5505-f6f9-4242-8b24-e3d699a195d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:37.280726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-563cab97-b0cc-4663-a081-a76822ddb1e9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:37.282175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-563cab97-b0cc-4663-a081-a76822ddb1e9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:37.290774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-563cab97-b0cc-4663-a081-a76822ddb1e9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:37.291274 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-563cab97-b0cc-4663-a081-a76822ddb1e9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:37.292116 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-563cab97-b0cc-4663-a081-a76822ddb1e9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:37.292607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-563cab97-b0cc-4663-a081-a76822ddb1e9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:37.382393 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-190f5505-f6f9-4242-8b24-e3d699a195d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:37.392127 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-190f5505-f6f9-4242-8b24-e3d699a195d2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1576 microversion: 2.1 time: 0.223358 Apr 14 16:17:37.392761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 453/905] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:37 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:37.397646 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-34c9a65d-f4d5-4473-b6bb-7d454d8c2ca9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:37.398783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-34c9a65d-f4d5-4473-b6bb-7d454d8c2ca9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:37.406229 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-34c9a65d-f4d5-4473-b6bb-7d454d8c2ca9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:37.407001 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-34c9a65d-f4d5-4473-b6bb-7d454d8c2ca9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:37.407838 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-34c9a65d-f4d5-4473-b6bb-7d454d8c2ca9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:37.408336 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-34c9a65d-f4d5-4473-b6bb-7d454d8c2ca9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:37.432768 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-563cab97-b0cc-4663-a081-a76822ddb1e9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 12803 microversion: 2.1 time: 0.156642 Apr 14 16:17:37.436701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 453/906] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:37 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 12803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:17:37.533654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-34c9a65d-f4d5-4473-b6bb-7d454d8c2ca9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 28774 microversion: 2.20 time: 0.139337 Apr 14 16:17:37.534291 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 454/907] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:37 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 28774 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:37.866651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1333250529", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-938127160", "security_groups": [{"name": "tempest-secgroup-smoke-374793546"}], "networks": [{"uuid": "01edfd4a-4731-488e-b758-1b065e88d2e9"}], "block_device_mapping_v2": [{"uuid": "4a048344-3ed9-463e-951f-4952ffd47adf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:37.961873 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b5d8cd98-7b72-45b7-b822-e314e8796b78 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:37.962523 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b5d8cd98-7b72-45b7-b822-e314e8796b78 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:37.971683 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5d8cd98-7b72-45b7-b822-e314e8796b78 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:37.972186 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5d8cd98-7b72-45b7-b822-e314e8796b78 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:37.973017 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5d8cd98-7b72-45b7-b822-e314e8796b78 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:37.973527 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5d8cd98-7b72-45b7-b822-e314e8796b78 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:38.040639 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] validate_networks() for [('01edfd4a-4731-488e-b758-1b065e88d2e9', None, None, None)] {{(pid=99335) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:17:38.044821 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b5d8cd98-7b72-45b7-b822-e314e8796b78 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Going to try to terminate instance {{(pid=99334) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:17:38.175138 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b5d8cd98-7b72-45b7-b822-e314e8796b78 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 204 len: 0 microversion: 2.1 time: 0.217879 Apr 14 16:17:38.176008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 455/908] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:17:37 2021] DELETE /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 14 16:17:38.185139 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-eac13a89-859a-4e58-84a7-a0f0c3b8049d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:38.186148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-eac13a89-859a-4e58-84a7-a0f0c3b8049d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:38.193739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eac13a89-859a-4e58-84a7-a0f0c3b8049d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:38.194246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eac13a89-859a-4e58-84a7-a0f0c3b8049d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:38.195083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eac13a89-859a-4e58-84a7-a0f0c3b8049d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:38.195798 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eac13a89-859a-4e58-84a7-a0f0c3b8049d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:38.396380 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-eac13a89-859a-4e58-84a7-a0f0c3b8049d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:38.406014 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-eac13a89-859a-4e58-84a7-a0f0c3b8049d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1513 microversion: 2.1 time: 0.225514 Apr 14 16:17:38.406896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 456/909] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:38 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:17:38.422091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5c5daefb-a7ef-494c-ae21-c5a3e776c7c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:38.422754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5c5daefb-a7ef-494c-ae21-c5a3e776c7c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:38.430514 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5c5daefb-a7ef-494c-ae21-c5a3e776c7c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:38.431023 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5c5daefb-a7ef-494c-ae21-c5a3e776c7c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:38.431864 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5c5daefb-a7ef-494c-ae21-c5a3e776c7c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:38.432355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5c5daefb-a7ef-494c-ae21-c5a3e776c7c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:38.682271 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Flavor limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:17:38.682861 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Image limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:17:38.683488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Flavor pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:17:38.684035 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Image pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:17:38.684576 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:17:38.694729 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:38.695846 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:38.696733 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:38.697294 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:38.717745 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Getting quotas for project 6afd00d65090450fa9559d0d5ef3a252. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:17:38.722503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Getting quotas for user e97db130f1f0412ab3a13ded5c7b7e01 and project 6afd00d65090450fa9559d0d5ef3a252. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:17:38.839483 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Going to run 1 instances... {{(pid=99335) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:17:38.842063 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a048344-3ed9-463e-951f-4952ffd47adf',volume_size=None,volume_type=None)] {{(pid=99335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:17:38.898245 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-5c5daefb-a7ef-494c-ae21-c5a3e776c7c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:38.908738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5c5daefb-a7ef-494c-ae21-c5a3e776c7c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1576 microversion: 2.1 time: 0.490216 Apr 14 16:17:38.909849 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 457/910] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:38 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1576 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:38.924783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-15e750d1-fa17-4567-ab1c-c090a19edb16 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:38.926403 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-15e750d1-fa17-4567-ab1c-c090a19edb16 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:38.935019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-15e750d1-fa17-4567-ab1c-c090a19edb16 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:38.935779 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-15e750d1-fa17-4567-ab1c-c090a19edb16 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:38.936783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-15e750d1-fa17-4567-ab1c-c090a19edb16 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:38.937337 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-15e750d1-fa17-4567-ab1c-c090a19edb16 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:39.040828 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-aa69bf0b-ba38-4813-aeb7-b6929275bfcc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.178566 Apr 14 16:17:39.047338 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 454/911] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:17:37 2021] POST /compute/v2.1/servers => generated 405 bytes in 1180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:17:39.047338 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3dbffe70-9d24-4520-b830-ed5a5629a7bb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:39.047689 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3dbffe70-9d24-4520-b830-ed5a5629a7bb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:39.056786 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3dbffe70-9d24-4520-b830-ed5a5629a7bb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:39.057363 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3dbffe70-9d24-4520-b830-ed5a5629a7bb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:39.059045 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3dbffe70-9d24-4520-b830-ed5a5629a7bb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:39.059649 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3dbffe70-9d24-4520-b830-ed5a5629a7bb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:39.068814 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-15e750d1-fa17-4567-ab1c-c090a19edb16 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 17659 microversion: 2.1 time: 0.154901 Apr 14 16:17:39.070761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 458/912] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:38 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 17659 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:17:39.077367 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-81b87a20-90eb-447a-8d01-6a5140c85d9a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:39.078647 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-81b87a20-90eb-447a-8d01-6a5140c85d9a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:39.219563 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-81b87a20-90eb-447a-8d01-6a5140c85d9a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:39.228395 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-81b87a20-90eb-447a-8d01-6a5140c85d9a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1088 microversion: 2.1 time: 0.155617 Apr 14 16:17:39.233108 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 459/913] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:39 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1088 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:39.234223 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3dbffe70-9d24-4520-b830-ed5a5629a7bb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 28774 microversion: 2.20 time: 0.191243 Apr 14 16:17:39.240217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 455/914] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:39 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 28774 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:39.425474 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-14b8b2ab-4c2f-48ae-8d0e-4acae7d2b0dd tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:39.426394 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-14b8b2ab-4c2f-48ae-8d0e-4acae7d2b0dd tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:39.436359 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-14b8b2ab-4c2f-48ae-8d0e-4acae7d2b0dd tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:39.436969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-14b8b2ab-4c2f-48ae-8d0e-4acae7d2b0dd tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:39.437996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-14b8b2ab-4c2f-48ae-8d0e-4acae7d2b0dd tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:39.438578 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-14b8b2ab-4c2f-48ae-8d0e-4acae7d2b0dd tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:39.656004 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-14b8b2ab-4c2f-48ae-8d0e-4acae7d2b0dd tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:39.666197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-14b8b2ab-4c2f-48ae-8d0e-4acae7d2b0dd tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1513 microversion: 2.1 time: 0.244923 Apr 14 16:17:39.667164 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 460/915] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:39 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:39.928581 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cd325a5c-e29e-4dc0-8b5a-ab49522a124b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:39.929381 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cd325a5c-e29e-4dc0-8b5a-ab49522a124b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:39.938377 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd325a5c-e29e-4dc0-8b5a-ab49522a124b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:39.938881 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd325a5c-e29e-4dc0-8b5a-ab49522a124b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:39.939717 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd325a5c-e29e-4dc0-8b5a-ab49522a124b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:39.940204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd325a5c-e29e-4dc0-8b5a-ab49522a124b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:40.081070 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cd325a5c-e29e-4dc0-8b5a-ab49522a124b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:40.082710 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3e3788ef-7568-43f1-9182-dc129617cac7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:40.083999 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3e3788ef-7568-43f1-9182-dc129617cac7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:40.092667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cd325a5c-e29e-4dc0-8b5a-ab49522a124b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1509 microversion: 2.1 time: 0.168518 Apr 14 16:17:40.093700 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 456/916] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:39 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:40.110899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e3788ef-7568-43f1-9182-dc129617cac7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:40.111428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e3788ef-7568-43f1-9182-dc129617cac7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:40.117836 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e3788ef-7568-43f1-9182-dc129617cac7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:40.118361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e3788ef-7568-43f1-9182-dc129617cac7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:40.237111 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3e3788ef-7568-43f1-9182-dc129617cac7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 17834 microversion: 2.1 time: 0.158828 Apr 14 16:17:40.237712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 461/917] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:40 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 17834 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:17:40.247538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3bcd3ea1-ff45-417b-a7bd-e1c418272e9d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:40.248316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3bcd3ea1-ff45-417b-a7bd-e1c418272e9d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:40.248810 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f602b613-487f-4e3c-a86c-bb00344e66b8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:40.250196 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f602b613-487f-4e3c-a86c-bb00344e66b8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:40.257407 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3bcd3ea1-ff45-417b-a7bd-e1c418272e9d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:40.258487 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3bcd3ea1-ff45-417b-a7bd-e1c418272e9d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:40.259510 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3bcd3ea1-ff45-417b-a7bd-e1c418272e9d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:40.260005 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3bcd3ea1-ff45-417b-a7bd-e1c418272e9d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:40.261058 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f602b613-487f-4e3c-a86c-bb00344e66b8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:40.261771 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f602b613-487f-4e3c-a86c-bb00344e66b8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:40.262629 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f602b613-487f-4e3c-a86c-bb00344e66b8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:40.263138 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f602b613-487f-4e3c-a86c-bb00344e66b8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:40.391183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f602b613-487f-4e3c-a86c-bb00344e66b8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 28774 microversion: 2.20 time: 0.148465 Apr 14 16:17:40.395625 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 457/918] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:40 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 28774 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:40.395831 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3bcd3ea1-ff45-417b-a7bd-e1c418272e9d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:40.404201 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3bcd3ea1-ff45-417b-a7bd-e1c418272e9d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1186 microversion: 2.1 time: 0.161611 Apr 14 16:17:40.404855 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 462/919] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:40 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1186 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:40.693812 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-86595591-29a6-448a-a73d-9cc5b5604232 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:40.694941 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-86595591-29a6-448a-a73d-9cc5b5604232 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:40.708493 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-86595591-29a6-448a-a73d-9cc5b5604232 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:40.709129 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-86595591-29a6-448a-a73d-9cc5b5604232 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:40.710095 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-86595591-29a6-448a-a73d-9cc5b5604232 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:40.710668 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-86595591-29a6-448a-a73d-9cc5b5604232 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:40.774693 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-2d734bf8-8fb8-4696-b419-8b7de4ee0a98 req-dc5515b4-47f1-448d-87e5-664687b3ebc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bca69cc6-ca35-4146-8a19-b3e35097b152", "name": "network-vif-deleted", "tag": "795f1499-91ff-4e4d-8ef8-0d1a0241293e"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:40.776166 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:17:40.776166 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:17:40.795321 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-2d734bf8-8fb8-4696-b419-8b7de4ee0a98 req-dc5515b4-47f1-448d-87e5-664687b3ebc9 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:40.795824 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-2d734bf8-8fb8-4696-b419-8b7de4ee0a98 req-dc5515b4-47f1-448d-87e5-664687b3ebc9 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:40.837735 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-2d734bf8-8fb8-4696-b419-8b7de4ee0a98 req-dc5515b4-47f1-448d-87e5-664687b3ebc9 service nova] Creating event network-vif-deleted:795f1499-91ff-4e4d-8ef8-0d1a0241293e for instance bca69cc6-ca35-4146-8a19-b3e35097b152 on hv-cinder-78626 Apr 14 16:17:40.852570 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-2d734bf8-8fb8-4696-b419-8b7de4ee0a98 req-dc5515b4-47f1-448d-87e5-664687b3ebc9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081742 Apr 14 16:17:40.854320 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 463/920] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:17:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:17:41.119542 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-19195e85-68de-412a-ac79-79e201ffc730 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:41.120609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-19195e85-68de-412a-ac79-79e201ffc730 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:41.147774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19195e85-68de-412a-ac79-79e201ffc730 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:41.148226 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19195e85-68de-412a-ac79-79e201ffc730 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:41.152661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19195e85-68de-412a-ac79-79e201ffc730 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:41.153204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-19195e85-68de-412a-ac79-79e201ffc730 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:41.157009 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-86595591-29a6-448a-a73d-9cc5b5604232 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:41.170677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-86595591-29a6-448a-a73d-9cc5b5604232 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1513 microversion: 2.1 time: 0.485053 Apr 14 16:17:41.185111 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 458/921] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:40 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1513 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:41.249105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-00a35611-8b0d-4ea0-9046-343f3e853e77 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:41.251043 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-00a35611-8b0d-4ea0-9046-343f3e853e77 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:41.262249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00a35611-8b0d-4ea0-9046-343f3e853e77 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:41.263161 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00a35611-8b0d-4ea0-9046-343f3e853e77 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:41.264250 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00a35611-8b0d-4ea0-9046-343f3e853e77 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:41.265054 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00a35611-8b0d-4ea0-9046-343f3e853e77 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:41.383571 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-19195e85-68de-412a-ac79-79e201ffc730 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:41.408509 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-19195e85-68de-412a-ac79-79e201ffc730 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1223 microversion: 2.1 time: 0.300405 Apr 14 16:17:41.409497 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 464/922] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:41 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1223 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:41.420581 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-212a4ca9-319e-421b-9240-0a25bd87bbc1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:41.421948 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-212a4ca9-319e-421b-9240-0a25bd87bbc1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:41.434795 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-00a35611-8b0d-4ea0-9046-343f3e853e77 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 19342 microversion: 2.1 time: 0.189619 Apr 14 16:17:41.438744 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 459/923] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:41 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 19342 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:17:41.442132 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d2efb659-b248-452a-9c96-af519498c800 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:41.444834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-212a4ca9-319e-421b-9240-0a25bd87bbc1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:41.445526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d2efb659-b248-452a-9c96-af519498c800 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:41.445990 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-212a4ca9-319e-421b-9240-0a25bd87bbc1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:41.461763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-212a4ca9-319e-421b-9240-0a25bd87bbc1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:41.463008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-212a4ca9-319e-421b-9240-0a25bd87bbc1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:41.469637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d2efb659-b248-452a-9c96-af519498c800 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:41.470343 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d2efb659-b248-452a-9c96-af519498c800 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:41.480297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d2efb659-b248-452a-9c96-af519498c800 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:41.481543 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d2efb659-b248-452a-9c96-af519498c800 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:41.685114 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-212a4ca9-319e-421b-9240-0a25bd87bbc1 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 28774 microversion: 2.20 time: 0.268236 Apr 14 16:17:41.686981 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 465/924] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:41 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 28774 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:41.766730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d2efb659-b248-452a-9c96-af519498c800 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:41.782339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d2efb659-b248-452a-9c96-af519498c800 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1204 microversion: 2.1 time: 0.342593 Apr 14 16:17:41.783204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 460/925] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:41 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1204 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:42.173604 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-99a2da45-7ccd-4079-8c3a-ec284aeda8d5 req-290509eb-dcfa-4af8-8e51-2fa40b7a697b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c19596f-1b41-4441-aac8-f715ca5e16d7", "name": "network-vif-deleted", "tag": "8524978b-5f78-400b-b215-ca84451f8af6"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:42.175889 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:17:42.175889 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:17:42.188143 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-99a2da45-7ccd-4079-8c3a-ec284aeda8d5 req-290509eb-dcfa-4af8-8e51-2fa40b7a697b service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:42.188682 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-99a2da45-7ccd-4079-8c3a-ec284aeda8d5 req-290509eb-dcfa-4af8-8e51-2fa40b7a697b service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:42.191470 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ba1eae58-26e9-4150-8b77-3e0c7ae3eaeb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:42.192455 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ba1eae58-26e9-4150-8b77-3e0c7ae3eaeb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:42.202400 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ba1eae58-26e9-4150-8b77-3e0c7ae3eaeb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:42.203235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ba1eae58-26e9-4150-8b77-3e0c7ae3eaeb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:42.203925 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ba1eae58-26e9-4150-8b77-3e0c7ae3eaeb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:42.204500 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ba1eae58-26e9-4150-8b77-3e0c7ae3eaeb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:42.213299 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-99a2da45-7ccd-4079-8c3a-ec284aeda8d5 req-290509eb-dcfa-4af8-8e51-2fa40b7a697b service nova] Creating event network-vif-deleted:8524978b-5f78-400b-b215-ca84451f8af6 for instance 6c19596f-1b41-4441-aac8-f715ca5e16d7 on hv-cinder-78626 Apr 14 16:17:42.225166 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-99a2da45-7ccd-4079-8c3a-ec284aeda8d5 req-290509eb-dcfa-4af8-8e51-2fa40b7a697b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055967 Apr 14 16:17:42.226479 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 466/926] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:17:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:17:42.387771 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ba1eae58-26e9-4150-8b77-3e0c7ae3eaeb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:42.399358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ba1eae58-26e9-4150-8b77-3e0c7ae3eaeb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 200 len: 1303 microversion: 2.1 time: 0.211557 Apr 14 16:17:42.410156 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 461/927] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:42 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 1303 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:42.431052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a0cca339-84fe-4346-9883-d9efc1c37a7d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:42.431857 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a0cca339-84fe-4346-9883-d9efc1c37a7d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:42.446900 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0cca339-84fe-4346-9883-d9efc1c37a7d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:42.447414 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0cca339-84fe-4346-9883-d9efc1c37a7d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:42.447644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8866c9ab-820a-4614-96d2-16c975acd5c4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:42.448566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0cca339-84fe-4346-9883-d9efc1c37a7d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:42.448679 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8866c9ab-820a-4614-96d2-16c975acd5c4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:42.449097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0cca339-84fe-4346-9883-d9efc1c37a7d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:42.457920 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8866c9ab-820a-4614-96d2-16c975acd5c4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:42.458359 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8866c9ab-820a-4614-96d2-16c975acd5c4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:42.459227 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8866c9ab-820a-4614-96d2-16c975acd5c4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:42.459721 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8866c9ab-820a-4614-96d2-16c975acd5c4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:42.557522 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0cca339-84fe-4346-9883-d9efc1c37a7d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:42.558212 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a0cca339-84fe-4346-9883-d9efc1c37a7d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:42.558925 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-a0cca339-84fe-4346-9883-d9efc1c37a7d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lazy-loading 'fault' on Instance uuid bca69cc6-ca35-4146-8a19-b3e35097b152 {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:17:42.629375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8866c9ab-820a-4614-96d2-16c975acd5c4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 21570 microversion: 2.1 time: 0.186232 Apr 14 16:17:42.630092 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 462/928] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:42 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 21570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:17:42.644364 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a0cca339-84fe-4346-9883-d9efc1c37a7d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:42.660699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a0cca339-84fe-4346-9883-d9efc1c37a7d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 200 len: 1228 microversion: 2.1 time: 0.237304 Apr 14 16:17:42.663412 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 467/929] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:42 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 1228 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:42.705462 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bb3582a7-a8f0-4c9e-bf62-d26fb8d427fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:42.708723 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bb3582a7-a8f0-4c9e-bf62-d26fb8d427fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:42.722178 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bb3582a7-a8f0-4c9e-bf62-d26fb8d427fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:42.722686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bb3582a7-a8f0-4c9e-bf62-d26fb8d427fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:42.723537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bb3582a7-a8f0-4c9e-bf62-d26fb8d427fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:42.725686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bb3582a7-a8f0-4c9e-bf62-d26fb8d427fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:42.802632 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-60cfde1d-b334-4530-8da0-caaeeaecc61e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:42.803352 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-60cfde1d-b334-4530-8da0-caaeeaecc61e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:42.812870 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-60cfde1d-b334-4530-8da0-caaeeaecc61e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:42.813403 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-60cfde1d-b334-4530-8da0-caaeeaecc61e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:42.814493 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-60cfde1d-b334-4530-8da0-caaeeaecc61e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:42.814989 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-60cfde1d-b334-4530-8da0-caaeeaecc61e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:42.858724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bb3582a7-a8f0-4c9e-bf62-d26fb8d427fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 29489 microversion: 2.20 time: 0.163531 Apr 14 16:17:42.859800 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 463/930] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:42 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 29489 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:43.048236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-60cfde1d-b334-4530-8da0-caaeeaecc61e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:43.060668 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-60cfde1d-b334-4530-8da0-caaeeaecc61e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1259 microversion: 2.1 time: 0.263347 Apr 14 16:17:43.067140 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 468/931] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:42 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1259 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:43.418747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-482da1de-8e67-4922-b27b-fb403d6df3b3 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:43.419526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-482da1de-8e67-4922-b27b-fb403d6df3b3 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 6c19596f-1b41-4441-aac8-f715ca5e16d7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:43.433180 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-482da1de-8e67-4922-b27b-fb403d6df3b3 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:43.434484 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-482da1de-8e67-4922-b27b-fb403d6df3b3 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:43.434484 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-482da1de-8e67-4922-b27b-fb403d6df3b3 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:43.434966 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-482da1de-8e67-4922-b27b-fb403d6df3b3 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:43.490213 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-482da1de-8e67-4922-b27b-fb403d6df3b3 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] HTTP exception thrown: Instance 6c19596f-1b41-4441-aac8-f715ca5e16d7 could not be found. Apr 14 16:17:43.490899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-482da1de-8e67-4922-b27b-fb403d6df3b3 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Returning 404 to user: Instance 6c19596f-1b41-4441-aac8-f715ca5e16d7 could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:17:43.491829 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-482da1de-8e67-4922-b27b-fb403d6df3b3 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7" status: 404 len: 111 microversion: 2.1 time: 0.078040 Apr 14 16:17:43.492957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 464/932] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:43 2021] GET /compute/v2.1/servers/6c19596f-1b41-4441-aac8-f715ca5e16d7 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:17:43.643629 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5310bca4-0bc3-4bb3-8322-92ef174ac3ff tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:43.644754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5310bca4-0bc3-4bb3-8322-92ef174ac3ff tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:43.653645 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5310bca4-0bc3-4bb3-8322-92ef174ac3ff tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:43.653991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5310bca4-0bc3-4bb3-8322-92ef174ac3ff tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:43.655206 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5310bca4-0bc3-4bb3-8322-92ef174ac3ff tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:43.655350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5310bca4-0bc3-4bb3-8322-92ef174ac3ff tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:43.683629 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f619eae1-aa42-48bc-8fbe-beb7e313ce2b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:43.684664 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f619eae1-aa42-48bc-8fbe-beb7e313ce2b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:43.694059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f619eae1-aa42-48bc-8fbe-beb7e313ce2b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:43.694791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f619eae1-aa42-48bc-8fbe-beb7e313ce2b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:43.696018 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f619eae1-aa42-48bc-8fbe-beb7e313ce2b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:43.696848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f619eae1-aa42-48bc-8fbe-beb7e313ce2b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:43.751388 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-f619eae1-aa42-48bc-8fbe-beb7e313ce2b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] HTTP exception thrown: Instance bca69cc6-ca35-4146-8a19-b3e35097b152 could not be found. Apr 14 16:17:43.752335 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f619eae1-aa42-48bc-8fbe-beb7e313ce2b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Returning 404 to user: Instance bca69cc6-ca35-4146-8a19-b3e35097b152 could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:17:43.753463 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f619eae1-aa42-48bc-8fbe-beb7e313ce2b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 404 len: 111 microversion: 2.1 time: 0.075532 Apr 14 16:17:43.754603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 465/933] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:43 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:17:43.780328 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5310bca4-0bc3-4bb3-8322-92ef174ac3ff tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 22988 microversion: 2.1 time: 0.140481 Apr 14 16:17:43.781021 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 469/934] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:43 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 22988 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:17:43.871948 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-60262321-89b0-4290-a224-17a2eed7257b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:43.872915 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-60262321-89b0-4290-a224-17a2eed7257b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:43.881822 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-60262321-89b0-4290-a224-17a2eed7257b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:43.882559 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-60262321-89b0-4290-a224-17a2eed7257b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:43.883237 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-60262321-89b0-4290-a224-17a2eed7257b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:43.883851 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-60262321-89b0-4290-a224-17a2eed7257b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:43.894740 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1276926191", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-643900673", "security_groups": [{"name": "tempest-secgroup-smoke-944231262"}], "block_device_mapping_v2": [{"uuid": "a7d6301b-feed-44b8-8c11-9914455f829a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f231942-4227-4866-b347-c39ce3e77e17"}]}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:44.015544 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-60262321-89b0-4290-a224-17a2eed7257b tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 31104 microversion: 2.20 time: 0.148125 Apr 14 16:17:44.017160 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 466/935] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:43 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 31104 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:44.023061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-eba71032-05dd-4f11-bc13-94485b26a34a req-8f32922e-94bd-4b4f-ab03-9d2471efff13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec37842c-337c-481a-b350-8055f911d09b", "tag": "eb2c22c1-6bf1-4f7d-b0f0-ca1c076c35be"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:44.025701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:17:44.025701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:17:44.037571 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-eba71032-05dd-4f11-bc13-94485b26a34a req-8f32922e-94bd-4b4f-ab03-9d2471efff13 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:44.037706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-eba71032-05dd-4f11-bc13-94485b26a34a req-8f32922e-94bd-4b4f-ab03-9d2471efff13 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:44.057290 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-eba71032-05dd-4f11-bc13-94485b26a34a req-8f32922e-94bd-4b4f-ab03-9d2471efff13 service nova] Creating event network-changed:eb2c22c1-6bf1-4f7d-b0f0-ca1c076c35be for instance ec37842c-337c-481a-b350-8055f911d09b on hv-cinder-78626 Apr 14 16:17:44.062913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-eba71032-05dd-4f11-bc13-94485b26a34a req-8f32922e-94bd-4b4f-ab03-9d2471efff13 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044161 Apr 14 16:17:44.063809 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 467/936] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:17:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:17:44.112601 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-95831cc2-fed5-4eef-a6cf-78ca54f1913a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:44.113630 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-95831cc2-fed5-4eef-a6cf-78ca54f1913a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:44.130954 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] validate_networks() for [('7f231942-4227-4866-b347-c39ce3e77e17', None, None, None)] {{(pid=99334) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:17:44.134571 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-95831cc2-fed5-4eef-a6cf-78ca54f1913a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:44.136539 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-95831cc2-fed5-4eef-a6cf-78ca54f1913a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:44.138952 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-95831cc2-fed5-4eef-a6cf-78ca54f1913a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:44.139538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-95831cc2-fed5-4eef-a6cf-78ca54f1913a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:44.403507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-95831cc2-fed5-4eef-a6cf-78ca54f1913a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:44.416329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-95831cc2-fed5-4eef-a6cf-78ca54f1913a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1259 microversion: 2.1 time: 0.329714 Apr 14 16:17:44.416987 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 468/937] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:44 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1259 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:44.760236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Flavor limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:17:44.760726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Image limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:17:44.761274 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Flavor pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:17:44.761746 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Image pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:17:44.762350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:17:44.771484 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:44.771979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:44.772843 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:44.773457 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:44.792457 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Getting quotas for project ed9d2e253f144da0bf1bbc63b4657b81. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:17:44.796870 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-44165430-a40f-44fc-ba36-fff1c901adcd tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:44.797157 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Getting quotas for user c9637a87d0cc41bb87b2437326c01992 and project ed9d2e253f144da0bf1bbc63b4657b81. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:17:44.797958 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-44165430-a40f-44fc-ba36-fff1c901adcd tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:44.806508 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44165430-a40f-44fc-ba36-fff1c901adcd tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:44.807120 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44165430-a40f-44fc-ba36-fff1c901adcd tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:44.807968 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44165430-a40f-44fc-ba36-fff1c901adcd tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:44.808463 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44165430-a40f-44fc-ba36-fff1c901adcd tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:44.923383 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Going to run 1 instances... {{(pid=99334) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:17:44.926070 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a7d6301b-feed-44b8-8c11-9914455f829a',volume_size=None,volume_type=None)] {{(pid=99334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:17:45.108035 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b5f5aba9-62f6-434f-9451-d4ba73ae1fe5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.219062 Apr 14 16:17:45.114566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 470/938] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:17:43 2021] POST /compute/v2.1/servers => generated 405 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:17:45.121632 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5ab33a09-400f-4307-9d11-79fef46c5cbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:45.123090 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5ab33a09-400f-4307-9d11-79fef46c5cbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:45.132056 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5ab33a09-400f-4307-9d11-79fef46c5cbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:45.132496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5ab33a09-400f-4307-9d11-79fef46c5cbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:45.133393 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5ab33a09-400f-4307-9d11-79fef46c5cbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:45.133892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5ab33a09-400f-4307-9d11-79fef46c5cbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:47.187324 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-44165430-a40f-44fc-ba36-fff1c901adcd tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 26189 microversion: 2.1 time: 2.394202 Apr 14 16:17:47.187977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 469/939] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:44 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 26189 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:17:47.193809 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b8c456d2-5ce1-4d26-913d-ba1209e23520 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:47.194592 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b8c456d2-5ce1-4d26-913d-ba1209e23520 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:47.204385 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8c456d2-5ce1-4d26-913d-ba1209e23520 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:47.204902 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8c456d2-5ce1-4d26-913d-ba1209e23520 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:47.206360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8c456d2-5ce1-4d26-913d-ba1209e23520 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:47.207013 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b8c456d2-5ce1-4d26-913d-ba1209e23520 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:47.207798 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5ab33a09-400f-4307-9d11-79fef46c5cbb tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 33637 microversion: 2.20 time: 2.097333 Apr 14 16:17:47.213350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 471/940] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:45 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 33637 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:47.220687 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d1fea745-2544-405d-9f93-41db96eb8c68 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:47.221518 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d1fea745-2544-405d-9f93-41db96eb8c68 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:47.231160 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d1fea745-2544-405d-9f93-41db96eb8c68 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:47.231671 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d1fea745-2544-405d-9f93-41db96eb8c68 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:47.232534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d1fea745-2544-405d-9f93-41db96eb8c68 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:47.233062 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d1fea745-2544-405d-9f93-41db96eb8c68 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:47.433666 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b8c456d2-5ce1-4d26-913d-ba1209e23520 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:47.443109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b8c456d2-5ce1-4d26-913d-ba1209e23520 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1144 microversion: 2.1 time: 0.253619 Apr 14 16:17:47.443954 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 470/941] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:47 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1144 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:47.446781 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d1fea745-2544-405d-9f93-41db96eb8c68 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:47.455931 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d1fea745-2544-405d-9f93-41db96eb8c68 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1259 microversion: 2.1 time: 0.240672 Apr 14 16:17:47.456547 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 472/942] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:47 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:48.201593 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-da13b27b-2174-4711-adce-fe61febbbffc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:48.203529 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-da13b27b-2174-4711-adce-fe61febbbffc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:48.214172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da13b27b-2174-4711-adce-fe61febbbffc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:48.214976 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da13b27b-2174-4711-adce-fe61febbbffc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:48.220649 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8f9f989d-03b2-4a6d-9dc9-0574ed04711d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:48.221920 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8f9f989d-03b2-4a6d-9dc9-0574ed04711d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:48.226071 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da13b27b-2174-4711-adce-fe61febbbffc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:48.227246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da13b27b-2174-4711-adce-fe61febbbffc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:48.235100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f9f989d-03b2-4a6d-9dc9-0574ed04711d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:48.235594 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f9f989d-03b2-4a6d-9dc9-0574ed04711d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:48.236419 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f9f989d-03b2-4a6d-9dc9-0574ed04711d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:48.236901 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f9f989d-03b2-4a6d-9dc9-0574ed04711d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:48.414378 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8f9f989d-03b2-4a6d-9dc9-0574ed04711d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 34205 microversion: 2.20 time: 0.197317 Apr 14 16:17:48.415671 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 473/943] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:48 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 34205 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:17:48.426255 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-da13b27b-2174-4711-adce-fe61febbbffc tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 26959 microversion: 2.1 time: 0.230125 Apr 14 16:17:48.426976 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 471/944] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:48 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 26959 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:17:48.463583 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9002dcea-c856-4472-9178-3b670f753548 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:48.464675 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9002dcea-c856-4472-9178-3b670f753548 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:48.475546 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9002dcea-c856-4472-9178-3b670f753548 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:48.476069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b738253c-15e9-4153-99aa-2ddc9f1c4e26 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:48.477424 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9002dcea-c856-4472-9178-3b670f753548 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:48.477616 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b738253c-15e9-4153-99aa-2ddc9f1c4e26 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:48.478703 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9002dcea-c856-4472-9178-3b670f753548 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:48.479433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9002dcea-c856-4472-9178-3b670f753548 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:48.487332 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b738253c-15e9-4153-99aa-2ddc9f1c4e26 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:48.487841 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b738253c-15e9-4153-99aa-2ddc9f1c4e26 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:48.488863 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b738253c-15e9-4153-99aa-2ddc9f1c4e26 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:48.489405 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b738253c-15e9-4153-99aa-2ddc9f1c4e26 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:48.624590 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9002dcea-c856-4472-9178-3b670f753548 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:48.634887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9002dcea-c856-4472-9178-3b670f753548 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1210 microversion: 2.1 time: 0.176632 Apr 14 16:17:48.635753 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 474/945] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:48 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1210 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:48.707538 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b738253c-15e9-4153-99aa-2ddc9f1c4e26 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:48.716765 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b738253c-15e9-4153-99aa-2ddc9f1c4e26 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1259 microversion: 2.1 time: 0.245388 Apr 14 16:17:48.717656 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 472/946] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:48 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1259 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:49.427890 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ecec6dab-18d9-4ae9-9c47-714d09bb6efc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:49.428915 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ecec6dab-18d9-4ae9-9c47-714d09bb6efc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:49.439117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f7281645-9246-4371-895d-415d6437c16f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:49.440359 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f7281645-9246-4371-895d-415d6437c16f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:49.441218 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ecec6dab-18d9-4ae9-9c47-714d09bb6efc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:49.442607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ecec6dab-18d9-4ae9-9c47-714d09bb6efc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:49.443660 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ecec6dab-18d9-4ae9-9c47-714d09bb6efc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:49.444987 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ecec6dab-18d9-4ae9-9c47-714d09bb6efc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:49.450454 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f7281645-9246-4371-895d-415d6437c16f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:49.452129 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f7281645-9246-4371-895d-415d6437c16f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:49.453178 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f7281645-9246-4371-895d-415d6437c16f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:49.453990 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f7281645-9246-4371-895d-415d6437c16f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:49.567639 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ecec6dab-18d9-4ae9-9c47-714d09bb6efc tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 35127 microversion: 2.20 time: 0.143276 Apr 14 16:17:49.568253 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 475/947] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:49 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 35127 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:49.613254 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f7281645-9246-4371-895d-415d6437c16f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 27579 microversion: 2.1 time: 0.177820 Apr 14 16:17:49.614916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 473/948] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:49 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 27579 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:17:49.655318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ce02ffec-e0e9-4afc-b487-8b1ff2e40aa4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:49.656086 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ce02ffec-e0e9-4afc-b487-8b1ff2e40aa4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:49.666188 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ce02ffec-e0e9-4afc-b487-8b1ff2e40aa4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:49.666701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ce02ffec-e0e9-4afc-b487-8b1ff2e40aa4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:49.667692 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ce02ffec-e0e9-4afc-b487-8b1ff2e40aa4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:49.668185 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ce02ffec-e0e9-4afc-b487-8b1ff2e40aa4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:49.736017 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-25e26d18-a911-4743-b732-b989216f8697 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:49.737165 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-25e26d18-a911-4743-b732-b989216f8697 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:49.759347 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25e26d18-a911-4743-b732-b989216f8697 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:49.759900 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25e26d18-a911-4743-b732-b989216f8697 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:49.760769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25e26d18-a911-4743-b732-b989216f8697 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:49.761306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-25e26d18-a911-4743-b732-b989216f8697 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:50.095158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ce02ffec-e0e9-4afc-b487-8b1ff2e40aa4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:50.104954 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ce02ffec-e0e9-4afc-b487-8b1ff2e40aa4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1265 microversion: 2.1 time: 0.454073 Apr 14 16:17:50.105959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 476/949] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:49 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1265 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:17:50.125671 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-25e26d18-a911-4743-b732-b989216f8697 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:50.136305 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-25e26d18-a911-4743-b732-b989216f8697 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1259 microversion: 2.1 time: 0.404359 Apr 14 16:17:50.137092 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 474/950] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:49 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1259 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:50.581752 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-94dab98f-9fb4-4728-924c-691190934b06 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:50.582747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-94dab98f-9fb4-4728-924c-691190934b06 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:50.591863 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94dab98f-9fb4-4728-924c-691190934b06 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:50.592367 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94dab98f-9fb4-4728-924c-691190934b06 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:50.593256 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94dab98f-9fb4-4728-924c-691190934b06 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:50.593746 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94dab98f-9fb4-4728-924c-691190934b06 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:50.627166 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3896c2ff-5bd8-4a27-9933-8d3af7faf682 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:50.630102 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3896c2ff-5bd8-4a27-9933-8d3af7faf682 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:50.638808 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3896c2ff-5bd8-4a27-9933-8d3af7faf682 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:50.639323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3896c2ff-5bd8-4a27-9933-8d3af7faf682 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:50.640199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3896c2ff-5bd8-4a27-9933-8d3af7faf682 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:50.640906 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3896c2ff-5bd8-4a27-9933-8d3af7faf682 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:52.895893 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-94dab98f-9fb4-4728-924c-691190934b06 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 38258 microversion: 2.20 time: 2.318395 Apr 14 16:17:52.896843 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 477/951] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:50 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 38258 bytes in 2320 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:52.902845 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-243065d9-5cba-47ec-a1af-592dfbf78808 req-a8fe1036-45fb-4f92-b355-2893b960400e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e9d7202-fd85-4ea1-951b-77525e2984be", "tag": "e78fae0b-8829-413f-93d4-0aa5119937a2"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:52.904502 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:17:52.904502 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:17:52.916019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-243065d9-5cba-47ec-a1af-592dfbf78808 req-a8fe1036-45fb-4f92-b355-2893b960400e service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:52.916523 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-243065d9-5cba-47ec-a1af-592dfbf78808 req-a8fe1036-45fb-4f92-b355-2893b960400e service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:52.918931 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3896c2ff-5bd8-4a27-9933-8d3af7faf682 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 27771 microversion: 2.1 time: 2.296040 Apr 14 16:17:52.919895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 475/952] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:50 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 27771 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:17:52.930271 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d1cea66f-82f7-49c8-96e2-14eb7fcd054b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:52.931055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d1cea66f-82f7-49c8-96e2-14eb7fcd054b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:52.938709 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-243065d9-5cba-47ec-a1af-592dfbf78808 req-a8fe1036-45fb-4f92-b355-2893b960400e service nova] Creating event network-changed:e78fae0b-8829-413f-93d4-0aa5119937a2 for instance 7e9d7202-fd85-4ea1-951b-77525e2984be on hv-cinder-78626 Apr 14 16:17:52.939740 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d1cea66f-82f7-49c8-96e2-14eb7fcd054b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:52.940247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d1cea66f-82f7-49c8-96e2-14eb7fcd054b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:52.941122 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d1cea66f-82f7-49c8-96e2-14eb7fcd054b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:52.941623 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d1cea66f-82f7-49c8-96e2-14eb7fcd054b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:52.943924 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-243065d9-5cba-47ec-a1af-592dfbf78808 req-a8fe1036-45fb-4f92-b355-2893b960400e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045891 Apr 14 16:17:52.944710 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 478/953] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:17:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:17:52.950695 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-932fd72a-2e3c-4649-8eb6-f2415c84389d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:52.951463 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-932fd72a-2e3c-4649-8eb6-f2415c84389d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:52.959555 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-932fd72a-2e3c-4649-8eb6-f2415c84389d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:52.960061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-932fd72a-2e3c-4649-8eb6-f2415c84389d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:52.961568 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-932fd72a-2e3c-4649-8eb6-f2415c84389d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:52.962081 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-932fd72a-2e3c-4649-8eb6-f2415c84389d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:53.162885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d1cea66f-82f7-49c8-96e2-14eb7fcd054b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:53.172221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d1cea66f-82f7-49c8-96e2-14eb7fcd054b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1265 microversion: 2.1 time: 0.247633 Apr 14 16:17:53.172842 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 476/954] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:52 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:53.307435 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-932fd72a-2e3c-4649-8eb6-f2415c84389d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:53.316234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-932fd72a-2e3c-4649-8eb6-f2415c84389d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1259 microversion: 2.1 time: 0.369689 Apr 14 16:17:53.316860 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 479/955] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:52 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1259 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:53.908639 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1e06c3be-1ad9-4f16-a5f0-f6d648eb9887 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:53.909975 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1e06c3be-1ad9-4f16-a5f0-f6d648eb9887 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:53.918525 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e06c3be-1ad9-4f16-a5f0-f6d648eb9887 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:53.918953 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e06c3be-1ad9-4f16-a5f0-f6d648eb9887 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:53.919941 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e06c3be-1ad9-4f16-a5f0-f6d648eb9887 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:53.920440 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1e06c3be-1ad9-4f16-a5f0-f6d648eb9887 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:53.932507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b0f25472-39b5-4e40-be4a-4a7d673ccff6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:53.933758 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b0f25472-39b5-4e40-be4a-4a7d673ccff6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:53.942899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b0f25472-39b5-4e40-be4a-4a7d673ccff6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:53.943495 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b0f25472-39b5-4e40-be4a-4a7d673ccff6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:53.944427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b0f25472-39b5-4e40-be4a-4a7d673ccff6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:53.945001 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b0f25472-39b5-4e40-be4a-4a7d673ccff6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:54.047237 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1e06c3be-1ad9-4f16-a5f0-f6d648eb9887 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 38327 microversion: 2.20 time: 0.142795 Apr 14 16:17:54.051557 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 477/956] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:53 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 38327 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:54.053525 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-90623975", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452", "networks": [{"uuid": "e562779b-7387-40f5-b9de-d5621a56d934"}]}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:54.063303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b0f25472-39b5-4e40-be4a-4a7d673ccff6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 28190 microversion: 2.1 time: 0.135816 Apr 14 16:17:54.064068 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 480/957] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:53 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 28190 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:17:54.126507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] validate_networks() for [('e562779b-7387-40f5-b9de-d5621a56d934', None, None, None)] {{(pid=99335) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:17:54.191230 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-425eeaa2-c80b-44fb-9eb6-4719a5f95719 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:54.192202 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-425eeaa2-c80b-44fb-9eb6-4719a5f95719 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:54.201808 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-425eeaa2-c80b-44fb-9eb6-4719a5f95719 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:54.202304 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-425eeaa2-c80b-44fb-9eb6-4719a5f95719 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:54.203143 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-425eeaa2-c80b-44fb-9eb6-4719a5f95719 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:54.203628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-425eeaa2-c80b-44fb-9eb6-4719a5f95719 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:54.563631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-425eeaa2-c80b-44fb-9eb6-4719a5f95719 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:54.573194 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-425eeaa2-c80b-44fb-9eb6-4719a5f95719 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1265 microversion: 2.1 time: 0.386564 Apr 14 16:17:54.574403 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 481/958] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:54 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1265 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:17:54.579464 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-69fe1a0b-ed7e-41a4-9acc-8f502a9032be tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:54.580123 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-69fe1a0b-ed7e-41a4-9acc-8f502a9032be tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:54.588974 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-69fe1a0b-ed7e-41a4-9acc-8f502a9032be tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:54.589515 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-69fe1a0b-ed7e-41a4-9acc-8f502a9032be tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:54.590373 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-69fe1a0b-ed7e-41a4-9acc-8f502a9032be tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:54.590873 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-69fe1a0b-ed7e-41a4-9acc-8f502a9032be tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:54.665774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Flavor limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:17:54.666258 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Image limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:17:54.666812 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Flavor pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:17:54.667280 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Image pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:17:54.667751 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:17:54.676766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:54.677354 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:54.678242 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:54.678800 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:54.697784 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Getting quotas for project 73844004f69a481dba93081e4d2b284e. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:17:54.702079 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Getting quotas for user 5e44d70d92dd4dc69199692b1caca12d and project 73844004f69a481dba93081e4d2b284e. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:17:54.714174 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Going to run 1 instances... {{(pid=99335) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:17:54.716908 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:17:54.767961 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b90cbc5c-d594-472a-a8cb-4ed6b43feb43 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718740 Apr 14 16:17:54.768676 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 478/959] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:17:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:17:54.779613 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b71d9fa4-c3f3-43ea-9636-c150a1351b13 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:54.780443 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b71d9fa4-c3f3-43ea-9636-c150a1351b13 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:54.801881 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-69fe1a0b-ed7e-41a4-9acc-8f502a9032be tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:54.811952 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-69fe1a0b-ed7e-41a4-9acc-8f502a9032be tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1259 microversion: 2.1 time: 0.236228 Apr 14 16:17:54.812514 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 482/960] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:54 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:54.865448 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b71d9fa4-c3f3-43ea-9636-c150a1351b13 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:54.874474 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b71d9fa4-c3f3-43ea-9636-c150a1351b13 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1217 microversion: 2.1 time: 0.098688 Apr 14 16:17:54.875083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 479/961] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:54 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:17:55.059899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c3be5ef3-4c16-4760-b47a-6ab544cb3090 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:55.060953 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c3be5ef3-4c16-4760-b47a-6ab544cb3090 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:55.068959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c3be5ef3-4c16-4760-b47a-6ab544cb3090 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:55.069506 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c3be5ef3-4c16-4760-b47a-6ab544cb3090 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:55.070869 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c3be5ef3-4c16-4760-b47a-6ab544cb3090 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:55.072774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c3be5ef3-4c16-4760-b47a-6ab544cb3090 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:55.076101 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ddfc4395-10de-44b7-8cf2-27c6243bc60a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:55.077280 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ddfc4395-10de-44b7-8cf2-27c6243bc60a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:55.086582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ddfc4395-10de-44b7-8cf2-27c6243bc60a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:55.086998 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ddfc4395-10de-44b7-8cf2-27c6243bc60a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:55.087850 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ddfc4395-10de-44b7-8cf2-27c6243bc60a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:55.088529 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ddfc4395-10de-44b7-8cf2-27c6243bc60a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:55.217742 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c3be5ef3-4c16-4760-b47a-6ab544cb3090 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 38327 microversion: 2.20 time: 0.161631 Apr 14 16:17:55.222134 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 483/962] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:55 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 38327 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:55.226226 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ddfc4395-10de-44b7-8cf2-27c6243bc60a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 28190 microversion: 2.1 time: 0.153779 Apr 14 16:17:55.230346 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 480/963] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:55 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 28190 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:17:55.592928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-26dc7dcd-629c-4f4a-b49d-37c22fcf95fc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:55.593743 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-26dc7dcd-629c-4f4a-b49d-37c22fcf95fc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:55.603111 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26dc7dcd-629c-4f4a-b49d-37c22fcf95fc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:55.603963 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26dc7dcd-629c-4f4a-b49d-37c22fcf95fc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:55.604912 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26dc7dcd-629c-4f4a-b49d-37c22fcf95fc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:55.605756 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26dc7dcd-629c-4f4a-b49d-37c22fcf95fc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:55.813180 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-26dc7dcd-629c-4f4a-b49d-37c22fcf95fc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:55.822654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-26dc7dcd-629c-4f4a-b49d-37c22fcf95fc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1265 microversion: 2.1 time: 0.234279 Apr 14 16:17:55.823556 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 484/964] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:55 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:55.830556 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f482a304-4145-4422-877d-a6f726c0e547 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:55.831329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f482a304-4145-4422-877d-a6f726c0e547 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:55.840520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f482a304-4145-4422-877d-a6f726c0e547 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:55.841028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f482a304-4145-4422-877d-a6f726c0e547 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:55.841892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f482a304-4145-4422-877d-a6f726c0e547 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:55.842383 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f482a304-4145-4422-877d-a6f726c0e547 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:55.893440 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a06b6550-ca1f-4c87-b17b-396c00bb8be9 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:55.894219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a06b6550-ca1f-4c87-b17b-396c00bb8be9 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:55.903500 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a06b6550-ca1f-4c87-b17b-396c00bb8be9 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:55.904015 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a06b6550-ca1f-4c87-b17b-396c00bb8be9 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:55.905636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a06b6550-ca1f-4c87-b17b-396c00bb8be9 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:55.906021 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a06b6550-ca1f-4c87-b17b-396c00bb8be9 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:56.081779 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f482a304-4145-4422-877d-a6f726c0e547 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:56.093099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f482a304-4145-4422-877d-a6f726c0e547 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1259 microversion: 2.1 time: 0.266927 Apr 14 16:17:56.093910 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 481/965] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:55 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1259 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:56.151415 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a06b6550-ca1f-4c87-b17b-396c00bb8be9 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:56.162111 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a06b6550-ca1f-4c87-b17b-396c00bb8be9 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1277 microversion: 2.1 time: 0.273821 Apr 14 16:17:56.162915 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 485/966] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:55 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1277 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:56.230548 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-56310681-cfd3-4b24-bcb6-28f72eba995f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:56.231739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-56310681-cfd3-4b24-bcb6-28f72eba995f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:56.239400 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5f7b62f0-c3aa-46ec-8e47-ce46a85bde9f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:56.240637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-56310681-cfd3-4b24-bcb6-28f72eba995f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:56.240801 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5f7b62f0-c3aa-46ec-8e47-ce46a85bde9f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:56.241410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-56310681-cfd3-4b24-bcb6-28f72eba995f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:56.242913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-56310681-cfd3-4b24-bcb6-28f72eba995f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:56.243537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-56310681-cfd3-4b24-bcb6-28f72eba995f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:56.251176 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f7b62f0-c3aa-46ec-8e47-ce46a85bde9f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:56.251683 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f7b62f0-c3aa-46ec-8e47-ce46a85bde9f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:56.252889 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f7b62f0-c3aa-46ec-8e47-ce46a85bde9f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:56.253416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5f7b62f0-c3aa-46ec-8e47-ce46a85bde9f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:56.376411 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-56310681-cfd3-4b24-bcb6-28f72eba995f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 200 len: 38468 microversion: 2.20 time: 0.149724 Apr 14 16:17:56.377395 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 482/967] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:56 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 38468 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:17:56.388994 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-68d71117-80a0-4e09-b574-60883f209ffd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:56.389673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-68d71117-80a0-4e09-b574-60883f209ffd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:56.392827 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5f7b62f0-c3aa-46ec-8e47-ce46a85bde9f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 28481 microversion: 2.1 time: 0.158243 Apr 14 16:17:56.397445 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 486/968] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:56 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 28481 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:17:56.398470 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-68d71117-80a0-4e09-b574-60883f209ffd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:56.398990 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-68d71117-80a0-4e09-b574-60883f209ffd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:56.399858 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-68d71117-80a0-4e09-b574-60883f209ffd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:56.400354 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-68d71117-80a0-4e09-b574-60883f209ffd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:56.462567 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-68d71117-80a0-4e09-b574-60883f209ffd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/ips" status: 200 len: 153 microversion: 2.20 time: 0.077896 Apr 14 16:17:56.463216 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 483/969] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Apr 14 16:17:56 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/ips => generated 153 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:17:56.841468 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6a5f7e40-c3a9-478c-9e91-4929a65c3145 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:56.842431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6a5f7e40-c3a9-478c-9e91-4929a65c3145 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:56.852410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a5f7e40-c3a9-478c-9e91-4929a65c3145 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:56.853894 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a5f7e40-c3a9-478c-9e91-4929a65c3145 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:56.854914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a5f7e40-c3a9-478c-9e91-4929a65c3145 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:56.855589 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6a5f7e40-c3a9-478c-9e91-4929a65c3145 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:57.111714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-10c345ad-651c-4edd-8dde-0be723157675 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:57.113129 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-10c345ad-651c-4edd-8dde-0be723157675 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:57.122265 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10c345ad-651c-4edd-8dde-0be723157675 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:57.123183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10c345ad-651c-4edd-8dde-0be723157675 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:57.124218 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10c345ad-651c-4edd-8dde-0be723157675 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:57.125140 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-10c345ad-651c-4edd-8dde-0be723157675 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:57.334179 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-10c345ad-651c-4edd-8dde-0be723157675 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:57.344111 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-10c345ad-651c-4edd-8dde-0be723157675 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1259 microversion: 2.1 time: 0.236329 Apr 14 16:17:57.344739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 484/970] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:57 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1259 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:57.349915 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b6e670bf-d25e-4423-b837-0b24b17697e2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:57.350556 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b6e670bf-d25e-4423-b837-0b24b17697e2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:57.359714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b6e670bf-d25e-4423-b837-0b24b17697e2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:57.360221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b6e670bf-d25e-4423-b837-0b24b17697e2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:57.361137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b6e670bf-d25e-4423-b837-0b24b17697e2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:57.361627 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b6e670bf-d25e-4423-b837-0b24b17697e2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:57.418686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6a5f7e40-c3a9-478c-9e91-4929a65c3145 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:57.427813 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6a5f7e40-c3a9-478c-9e91-4929a65c3145 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1265 microversion: 2.1 time: 0.590946 Apr 14 16:17:57.428584 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 487/971] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:56 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1265 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:57.434486 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-652bdbca-3288-400c-a9ae-ee1117b7e7a3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:57.435816 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-652bdbca-3288-400c-a9ae-ee1117b7e7a3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:57.444052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-652bdbca-3288-400c-a9ae-ee1117b7e7a3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:57.444655 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-652bdbca-3288-400c-a9ae-ee1117b7e7a3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:57.445819 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-652bdbca-3288-400c-a9ae-ee1117b7e7a3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:57.446525 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-652bdbca-3288-400c-a9ae-ee1117b7e7a3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:57.555471 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-652bdbca-3288-400c-a9ae-ee1117b7e7a3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 28649 microversion: 2.1 time: 0.124558 Apr 14 16:17:57.556409 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 488/972] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:57 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 28649 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:17:57.559670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b6e670bf-d25e-4423-b837-0b24b17697e2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:57.568537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b6e670bf-d25e-4423-b837-0b24b17697e2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1317 microversion: 2.1 time: 0.222558 Apr 14 16:17:57.569191 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 485/973] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:57 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:58.302849 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-a1d6af6c-7136-4deb-b5f6-5ad194c84b42 req-d196e51e-d5b9-4c22-9d94-e435236b5eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec37842c-337c-481a-b350-8055f911d09b", "name": "network-vif-plugged", "status": "completed", "tag": "eb2c22c1-6bf1-4f7d-b0f0-ca1c076c35be"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:58.305056 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:17:58.305056 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:17:58.315498 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-a1d6af6c-7136-4deb-b5f6-5ad194c84b42 req-d196e51e-d5b9-4c22-9d94-e435236b5eff service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:58.316146 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-a1d6af6c-7136-4deb-b5f6-5ad194c84b42 req-d196e51e-d5b9-4c22-9d94-e435236b5eff service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:58.335724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-a1d6af6c-7136-4deb-b5f6-5ad194c84b42 req-d196e51e-d5b9-4c22-9d94-e435236b5eff service nova] Creating event network-vif-plugged:eb2c22c1-6bf1-4f7d-b0f0-ca1c076c35be for instance ec37842c-337c-481a-b350-8055f911d09b on hv-cinder-78626 Apr 14 16:17:58.345027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-a1d6af6c-7136-4deb-b5f6-5ad194c84b42 req-d196e51e-d5b9-4c22-9d94-e435236b5eff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044456 Apr 14 16:17:58.345027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 489/974] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:17:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:17:58.362539 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-57ef3395-3df3-4755-88f6-cd3b00709aca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:58.363592 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-57ef3395-3df3-4755-88f6-cd3b00709aca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:58.372792 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-57ef3395-3df3-4755-88f6-cd3b00709aca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:58.373343 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-57ef3395-3df3-4755-88f6-cd3b00709aca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:58.374206 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-57ef3395-3df3-4755-88f6-cd3b00709aca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:58.374707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-57ef3395-3df3-4755-88f6-cd3b00709aca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:58.448600 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-49944a02-67d2-4e4e-9f59-edbc17c9907b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:58.449415 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-49944a02-67d2-4e4e-9f59-edbc17c9907b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:58.457783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49944a02-67d2-4e4e-9f59-edbc17c9907b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:58.458292 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49944a02-67d2-4e4e-9f59-edbc17c9907b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:58.459140 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49944a02-67d2-4e4e-9f59-edbc17c9907b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:58.459634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49944a02-67d2-4e4e-9f59-edbc17c9907b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:58.582722 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-57ef3395-3df3-4755-88f6-cd3b00709aca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:58.591925 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-57ef3395-3df3-4755-88f6-cd3b00709aca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1259 microversion: 2.1 time: 0.233393 Apr 14 16:17:58.592690 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 486/975] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:58 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1259 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:58.597761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a4ea0a86-4c63-4724-b51b-38b5714f2656 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:58.599012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a4ea0a86-4c63-4724-b51b-38b5714f2656 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:58.607003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4ea0a86-4c63-4724-b51b-38b5714f2656 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:58.607754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4ea0a86-4c63-4724-b51b-38b5714f2656 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:58.608607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4ea0a86-4c63-4724-b51b-38b5714f2656 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:58.609141 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4ea0a86-4c63-4724-b51b-38b5714f2656 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:58.724178 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a4ea0a86-4c63-4724-b51b-38b5714f2656 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 28649 microversion: 2.1 time: 0.129825 Apr 14 16:17:58.724882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 487/976] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:58 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 28649 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:17:58.731873 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a97018ef-454d-4245-95ca-31d4bbcb209d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:58.732981 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a97018ef-454d-4245-95ca-31d4bbcb209d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:58.741373 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a97018ef-454d-4245-95ca-31d4bbcb209d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:58.742014 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a97018ef-454d-4245-95ca-31d4bbcb209d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:58.744104 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a97018ef-454d-4245-95ca-31d4bbcb209d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:58.744602 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a97018ef-454d-4245-95ca-31d4bbcb209d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:58.872858 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-49944a02-67d2-4e4e-9f59-edbc17c9907b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:58.885251 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-49944a02-67d2-4e4e-9f59-edbc17c9907b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1265 microversion: 2.1 time: 0.441860 Apr 14 16:17:58.886012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 490/977] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:58 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1265 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:58.891302 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b6e92cfe-8018-4298-a606-c8cf018bb0ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:58.892207 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b6e92cfe-8018-4298-a606-c8cf018bb0ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:58.902153 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b6e92cfe-8018-4298-a606-c8cf018bb0ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:58.902871 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b6e92cfe-8018-4298-a606-c8cf018bb0ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:58.903876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b6e92cfe-8018-4298-a606-c8cf018bb0ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:58.904649 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b6e92cfe-8018-4298-a606-c8cf018bb0ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:58.951228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a97018ef-454d-4245-95ca-31d4bbcb209d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:58.960382 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a97018ef-454d-4245-95ca-31d4bbcb209d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1317 microversion: 2.1 time: 0.234022 Apr 14 16:17:58.961373 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 488/978] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:58 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:58.966223 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-2a4ccdf3-5f19-4047-af05-62b49682c003 req-6851e98a-825a-453a-b726-3a037a707e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ebf4fdb-09d1-44fa-b9ac-142842d75209", "tag": "b5f19e49-684a-45d4-875e-1398ffcf49b7"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:58.967955 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:17:58.967955 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:17:58.977880 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-2a4ccdf3-5f19-4047-af05-62b49682c003 req-6851e98a-825a-453a-b726-3a037a707e1b service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:58.978395 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-2a4ccdf3-5f19-4047-af05-62b49682c003 req-6851e98a-825a-453a-b726-3a037a707e1b service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:58.984974 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-b6e92cfe-8018-4298-a606-c8cf018bb0ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lazy-loading 'flavor' on Instance uuid 67e45e06-d4ec-48d7-8576-da008e2a2bbe {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:17:58.996512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-2a4ccdf3-5f19-4047-af05-62b49682c003 req-6851e98a-825a-453a-b726-3a037a707e1b service nova] Creating event network-changed:b5f19e49-684a-45d4-875e-1398ffcf49b7 for instance 1ebf4fdb-09d1-44fa-b9ac-142842d75209 on hv-cinder-78626 Apr 14 16:17:59.001541 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-2a4ccdf3-5f19-4047-af05-62b49682c003 req-6851e98a-825a-453a-b726-3a037a707e1b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038830 Apr 14 16:17:59.002360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 489/979] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:17:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:17:59.373297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b6e92cfe-8018-4298-a606-c8cf018bb0ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 202 len: 0 microversion: 2.20 time: 0.485413 Apr 14 16:17:59.377226 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 491/980] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:17:58 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:17:59.383496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-59f95728-426e-4de0-9936-606abd44da82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:59.384279 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-59f95728-426e-4de0-9936-606abd44da82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:59.392804 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59f95728-426e-4de0-9936-606abd44da82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:59.393402 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59f95728-426e-4de0-9936-606abd44da82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:59.394259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59f95728-426e-4de0-9936-606abd44da82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:59.394866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59f95728-426e-4de0-9936-606abd44da82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:59.595374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-59f95728-426e-4de0-9936-606abd44da82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:59.604977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-59f95728-426e-4de0-9936-606abd44da82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:59.606659 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-59f95728-426e-4de0-9936-606abd44da82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:59.607882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-59f95728-426e-4de0-9936-606abd44da82 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1723 microversion: 2.20 time: 0.229121 Apr 14 16:17:59.608493 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 490/981] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:17:59 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:17:59.612313 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c28a1e06-6515-4203-92de-4cf08d10b62e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:59.613107 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c28a1e06-6515-4203-92de-4cf08d10b62e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:59.621398 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c28a1e06-6515-4203-92de-4cf08d10b62e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:59.621916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c28a1e06-6515-4203-92de-4cf08d10b62e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:59.622759 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c28a1e06-6515-4203-92de-4cf08d10b62e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:59.623259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c28a1e06-6515-4203-92de-4cf08d10b62e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:59.737471 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-799fc7fd-259d-467e-94d1-1cd421e2359b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:17:59.738612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-799fc7fd-259d-467e-94d1-1cd421e2359b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:59.747144 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-799fc7fd-259d-467e-94d1-1cd421e2359b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:59.747651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-799fc7fd-259d-467e-94d1-1cd421e2359b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:59.748490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-799fc7fd-259d-467e-94d1-1cd421e2359b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:59.748983 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-799fc7fd-259d-467e-94d1-1cd421e2359b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:59.899508 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-799fc7fd-259d-467e-94d1-1cd421e2359b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 28649 microversion: 2.1 time: 0.165664 Apr 14 16:17:59.900627 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 491/982] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:17:59 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 28649 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:17:59.905982 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b251371e-a4cf-4d1b-8478-3f48eccd1a93 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:17:59.907101 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b251371e-a4cf-4d1b-8478-3f48eccd1a93 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:17:59.916067 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b251371e-a4cf-4d1b-8478-3f48eccd1a93 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:59.916576 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b251371e-a4cf-4d1b-8478-3f48eccd1a93 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:59.917453 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b251371e-a4cf-4d1b-8478-3f48eccd1a93 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:17:59.917945 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b251371e-a4cf-4d1b-8478-3f48eccd1a93 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:17:59.973542 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c28a1e06-6515-4203-92de-4cf08d10b62e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:17:59.990633 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c28a1e06-6515-4203-92de-4cf08d10b62e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1259 microversion: 2.1 time: 0.382586 Apr 14 16:17:59.996323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 492/983] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:59 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1259 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:18:00.001351 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3d9922d2-f185-4e30-ade2-5ace4ac16f1c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:00.002010 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3d9922d2-f185-4e30-ade2-5ace4ac16f1c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:00.024158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3d9922d2-f185-4e30-ade2-5ace4ac16f1c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:00.025286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3d9922d2-f185-4e30-ade2-5ace4ac16f1c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:00.026151 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3d9922d2-f185-4e30-ade2-5ace4ac16f1c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:00.026642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3d9922d2-f185-4e30-ade2-5ace4ac16f1c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:00.156063 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b251371e-a4cf-4d1b-8478-3f48eccd1a93 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:00.166209 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b251371e-a4cf-4d1b-8478-3f48eccd1a93 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1265 microversion: 2.1 time: 0.264510 Apr 14 16:18:00.166949 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 492/984] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:59 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:00.458109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3d9922d2-f185-4e30-ade2-5ace4ac16f1c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:00.466835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3d9922d2-f185-4e30-ade2-5ace4ac16f1c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1317 microversion: 2.1 time: 0.469270 Apr 14 16:18:00.467465 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 493/985] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:17:59 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:00.628356 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c6b6c310-f95c-45ae-b91f-57d31b716c1e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:00.629018 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c6b6c310-f95c-45ae-b91f-57d31b716c1e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:00.636978 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c6b6c310-f95c-45ae-b91f-57d31b716c1e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:00.637545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c6b6c310-f95c-45ae-b91f-57d31b716c1e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:00.638376 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c6b6c310-f95c-45ae-b91f-57d31b716c1e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:00.638872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c6b6c310-f95c-45ae-b91f-57d31b716c1e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:00.912936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-df7ebf85-5a6b-41b1-92af-fe49b57247ce tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:00.914407 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-df7ebf85-5a6b-41b1-92af-fe49b57247ce tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:00.922867 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df7ebf85-5a6b-41b1-92af-fe49b57247ce tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:00.923378 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df7ebf85-5a6b-41b1-92af-fe49b57247ce tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:00.924240 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df7ebf85-5a6b-41b1-92af-fe49b57247ce tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:00.924732 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df7ebf85-5a6b-41b1-92af-fe49b57247ce tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:01.047742 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-df7ebf85-5a6b-41b1-92af-fe49b57247ce tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 28649 microversion: 2.1 time: 0.137954 Apr 14 16:18:01.051996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 494/986] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:00 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 28649 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:18:01.054121 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9d3be7f1-0122-4d5f-bc52-99b9b616f1e5 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:01.055446 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9d3be7f1-0122-4d5f-bc52-99b9b616f1e5 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:01.064084 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c6b6c310-f95c-45ae-b91f-57d31b716c1e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:01.064243 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9d3be7f1-0122-4d5f-bc52-99b9b616f1e5 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:01.064621 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9d3be7f1-0122-4d5f-bc52-99b9b616f1e5 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:01.065504 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9d3be7f1-0122-4d5f-bc52-99b9b616f1e5 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:01.066004 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9d3be7f1-0122-4d5f-bc52-99b9b616f1e5 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:01.073890 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c6b6c310-f95c-45ae-b91f-57d31b716c1e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:01.075559 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c6b6c310-f95c-45ae-b91f-57d31b716c1e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:01.076771 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c6b6c310-f95c-45ae-b91f-57d31b716c1e tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1723 microversion: 2.20 time: 0.452645 Apr 14 16:18:01.077440 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 493/987] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:00 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1723 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:01.183705 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8db22461-fba9-4fc7-b1ef-5ab3ad0c3b81 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:01.184297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8db22461-fba9-4fc7-b1ef-5ab3ad0c3b81 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:01.192009 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8db22461-fba9-4fc7-b1ef-5ab3ad0c3b81 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:01.192512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8db22461-fba9-4fc7-b1ef-5ab3ad0c3b81 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:01.193373 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8db22461-fba9-4fc7-b1ef-5ab3ad0c3b81 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:01.193863 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8db22461-fba9-4fc7-b1ef-5ab3ad0c3b81 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:01.270943 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9d3be7f1-0122-4d5f-bc52-99b9b616f1e5 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:01.280811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9d3be7f1-0122-4d5f-bc52-99b9b616f1e5 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1442 microversion: 2.1 time: 0.230875 Apr 14 16:18:01.281503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 495/988] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:01 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1442 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:01.298102 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b57eb8c9-0be4-4940-9a38-ad056b507c7d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:01.298772 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b57eb8c9-0be4-4940-9a38-ad056b507c7d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:01.306428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b57eb8c9-0be4-4940-9a38-ad056b507c7d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:01.306938 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b57eb8c9-0be4-4940-9a38-ad056b507c7d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:01.307782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b57eb8c9-0be4-4940-9a38-ad056b507c7d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:01.308278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b57eb8c9-0be4-4940-9a38-ad056b507c7d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:01.395535 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8db22461-fba9-4fc7-b1ef-5ab3ad0c3b81 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:01.404679 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8db22461-fba9-4fc7-b1ef-5ab3ad0c3b81 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1265 microversion: 2.1 time: 0.225172 Apr 14 16:18:01.405342 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 494/989] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:01 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:18:01.485252 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-eb6ddc0f-e9d6-43bf-88c9-76645401e85d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:01.485934 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-eb6ddc0f-e9d6-43bf-88c9-76645401e85d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:01.494498 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb6ddc0f-e9d6-43bf-88c9-76645401e85d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:01.495015 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb6ddc0f-e9d6-43bf-88c9-76645401e85d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:01.495866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb6ddc0f-e9d6-43bf-88c9-76645401e85d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:01.496402 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-eb6ddc0f-e9d6-43bf-88c9-76645401e85d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:01.520791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b57eb8c9-0be4-4940-9a38-ad056b507c7d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:01.530361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b57eb8c9-0be4-4940-9a38-ad056b507c7d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1442 microversion: 2.1 time: 0.236086 Apr 14 16:18:01.531000 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 496/990] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:01 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1442 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:18:01.703197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-eb6ddc0f-e9d6-43bf-88c9-76645401e85d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:01.712382 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-eb6ddc0f-e9d6-43bf-88c9-76645401e85d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1317 microversion: 2.1 time: 0.231231 Apr 14 16:18:01.712988 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 495/991] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:01 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:18:02.060917 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5d431cb0-afb7-4bc3-a163-ad0a618df7e6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:02.062010 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5d431cb0-afb7-4bc3-a163-ad0a618df7e6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:02.071268 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5d431cb0-afb7-4bc3-a163-ad0a618df7e6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:02.071550 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5d431cb0-afb7-4bc3-a163-ad0a618df7e6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:02.072371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5d431cb0-afb7-4bc3-a163-ad0a618df7e6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:02.073089 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5d431cb0-afb7-4bc3-a163-ad0a618df7e6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:02.095921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-feac81d6-561f-4214-966e-0d3222465ce4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:02.096594 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-feac81d6-561f-4214-966e-0d3222465ce4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:02.115566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-feac81d6-561f-4214-966e-0d3222465ce4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:02.115566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-feac81d6-561f-4214-966e-0d3222465ce4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:02.116037 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-feac81d6-561f-4214-966e-0d3222465ce4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:02.116455 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-feac81d6-561f-4214-966e-0d3222465ce4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:02.190852 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5d431cb0-afb7-4bc3-a163-ad0a618df7e6 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 28649 microversion: 2.1 time: 0.133648 Apr 14 16:18:02.191771 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 497/992] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:02 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 28649 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:18:02.364393 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-feac81d6-561f-4214-966e-0d3222465ce4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:02.376372 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-feac81d6-561f-4214-966e-0d3222465ce4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:02.378743 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-feac81d6-561f-4214-966e-0d3222465ce4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:02.380476 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-feac81d6-561f-4214-966e-0d3222465ce4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1723 microversion: 2.20 time: 0.288562 Apr 14 16:18:02.381617 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 496/993] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:02 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:02.423847 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3778cb6e-3db4-4776-b924-a790b85ec8b0 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:02.424699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3778cb6e-3db4-4776-b924-a790b85ec8b0 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:02.433781 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3778cb6e-3db4-4776-b924-a790b85ec8b0 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:02.434292 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3778cb6e-3db4-4776-b924-a790b85ec8b0 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:02.435139 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3778cb6e-3db4-4776-b924-a790b85ec8b0 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:02.435628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3778cb6e-3db4-4776-b924-a790b85ec8b0 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:02.730266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-57c2bd83-5a86-4a0c-b1fa-a4a49aa4bbfb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:02.730974 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-57c2bd83-5a86-4a0c-b1fa-a4a49aa4bbfb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:02.738986 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-57c2bd83-5a86-4a0c-b1fa-a4a49aa4bbfb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:02.739487 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-57c2bd83-5a86-4a0c-b1fa-a4a49aa4bbfb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:02.740327 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-57c2bd83-5a86-4a0c-b1fa-a4a49aa4bbfb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:02.740813 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-57c2bd83-5a86-4a0c-b1fa-a4a49aa4bbfb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:02.802797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3778cb6e-3db4-4776-b924-a790b85ec8b0 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:02.814588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3778cb6e-3db4-4776-b924-a790b85ec8b0 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1265 microversion: 2.1 time: 0.394449 Apr 14 16:18:02.829615 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 498/994] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:02 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1265 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:02.943161 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-57c2bd83-5a86-4a0c-b1fa-a4a49aa4bbfb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:02.954651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-57c2bd83-5a86-4a0c-b1fa-a4a49aa4bbfb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1317 microversion: 2.1 time: 0.228467 Apr 14 16:18:02.955491 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 497/995] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:02 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:18:03.203748 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9a14b579-ec64-4129-b175-7725d2db14b9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:03.205204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9a14b579-ec64-4129-b175-7725d2db14b9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:03.213337 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9a14b579-ec64-4129-b175-7725d2db14b9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:03.213848 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9a14b579-ec64-4129-b175-7725d2db14b9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:03.214700 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9a14b579-ec64-4129-b175-7725d2db14b9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:03.215192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9a14b579-ec64-4129-b175-7725d2db14b9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:03.346470 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9a14b579-ec64-4129-b175-7725d2db14b9 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 29001 microversion: 2.1 time: 0.146517 Apr 14 16:18:03.348259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 499/996] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:03 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 29001 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:18:03.400480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9d92f870-04fb-4790-9914-e5b913d54a02 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:03.401083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9d92f870-04fb-4790-9914-e5b913d54a02 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:03.409130 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9d92f870-04fb-4790-9914-e5b913d54a02 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:03.409595 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9d92f870-04fb-4790-9914-e5b913d54a02 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:03.410431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9d92f870-04fb-4790-9914-e5b913d54a02 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:03.410917 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9d92f870-04fb-4790-9914-e5b913d54a02 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:03.616324 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9d92f870-04fb-4790-9914-e5b913d54a02 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:03.626083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9d92f870-04fb-4790-9914-e5b913d54a02 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:03.627761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9d92f870-04fb-4790-9914-e5b913d54a02 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:03.628996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9d92f870-04fb-4790-9914-e5b913d54a02 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1723 microversion: 2.20 time: 0.233024 Apr 14 16:18:03.629677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 498/997] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:03 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:03.848310 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6ec2b8aa-3872-4fc2-918a-afb44e20e1bb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:03.849114 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6ec2b8aa-3872-4fc2-918a-afb44e20e1bb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:03.858159 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ec2b8aa-3872-4fc2-918a-afb44e20e1bb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:03.858672 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ec2b8aa-3872-4fc2-918a-afb44e20e1bb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:03.859524 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ec2b8aa-3872-4fc2-918a-afb44e20e1bb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:03.860025 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ec2b8aa-3872-4fc2-918a-afb44e20e1bb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:03.972278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b952070e-dbed-40ab-a2ad-666ac0a0218c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:03.973075 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b952070e-dbed-40ab-a2ad-666ac0a0218c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:03.981282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b952070e-dbed-40ab-a2ad-666ac0a0218c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:03.981877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b952070e-dbed-40ab-a2ad-666ac0a0218c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:03.982801 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b952070e-dbed-40ab-a2ad-666ac0a0218c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:03.983377 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b952070e-dbed-40ab-a2ad-666ac0a0218c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:04.192105 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b952070e-dbed-40ab-a2ad-666ac0a0218c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:04.201777 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b952070e-dbed-40ab-a2ad-666ac0a0218c tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1317 microversion: 2.1 time: 0.233749 Apr 14 16:18:04.202421 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 499/998] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:03 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:18:04.359537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-953bda77-c6d2-4e77-9bcc-2689adc35c3b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:04.360658 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-953bda77-c6d2-4e77-9bcc-2689adc35c3b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:04.370114 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-953bda77-c6d2-4e77-9bcc-2689adc35c3b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:04.370634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-953bda77-c6d2-4e77-9bcc-2689adc35c3b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:04.371504 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-953bda77-c6d2-4e77-9bcc-2689adc35c3b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:04.372004 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-953bda77-c6d2-4e77-9bcc-2689adc35c3b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:04.497361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-953bda77-c6d2-4e77-9bcc-2689adc35c3b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 30143 microversion: 2.1 time: 0.141738 Apr 14 16:18:04.501688 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 500/999] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:04 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 30143 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:18:04.565909 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6ec2b8aa-3872-4fc2-918a-afb44e20e1bb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:04.575479 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6ec2b8aa-3872-4fc2-918a-afb44e20e1bb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1265 microversion: 2.1 time: 0.731789 Apr 14 16:18:04.576122 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 500/1000] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:03 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1265 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:04.649123 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-aff979a5-3a8a-4be0-8706-e16b4319d487 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:04.649850 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-aff979a5-3a8a-4be0-8706-e16b4319d487 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:04.658716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aff979a5-3a8a-4be0-8706-e16b4319d487 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:04.659222 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aff979a5-3a8a-4be0-8706-e16b4319d487 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:04.660072 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aff979a5-3a8a-4be0-8706-e16b4319d487 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:04.660571 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aff979a5-3a8a-4be0-8706-e16b4319d487 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:04.869063 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-aff979a5-3a8a-4be0-8706-e16b4319d487 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:04.878880 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-aff979a5-3a8a-4be0-8706-e16b4319d487 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:04.880578 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-aff979a5-3a8a-4be0-8706-e16b4319d487 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:04.881844 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-aff979a5-3a8a-4be0-8706-e16b4319d487 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1723 microversion: 2.20 time: 0.237639 Apr 14 16:18:04.882761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 501/1001] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:04 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:04.901160 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-a0a90156-1eb1-4b00-8aab-83c394da5808 req-29add05d-3020-4de4-b10a-c21c2f313d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec37842c-337c-481a-b350-8055f911d09b", "tag": "eb2c22c1-6bf1-4f7d-b0f0-ca1c076c35be"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:04.902784 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:18:04.902784 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:18:04.912350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-a0a90156-1eb1-4b00-8aab-83c394da5808 req-29add05d-3020-4de4-b10a-c21c2f313d90 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:04.912847 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-a0a90156-1eb1-4b00-8aab-83c394da5808 req-29add05d-3020-4de4-b10a-c21c2f313d90 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:04.931359 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-a0a90156-1eb1-4b00-8aab-83c394da5808 req-29add05d-3020-4de4-b10a-c21c2f313d90 service nova] Creating event network-changed:eb2c22c1-6bf1-4f7d-b0f0-ca1c076c35be for instance ec37842c-337c-481a-b350-8055f911d09b on hv-cinder-78626 Apr 14 16:18:04.936477 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-a0a90156-1eb1-4b00-8aab-83c394da5808 req-29add05d-3020-4de4-b10a-c21c2f313d90 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039509 Apr 14 16:18:04.937150 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 501/1002] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:18:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:05.220091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-04bf848d-8a0b-4801-a759-2f5d0f093182 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:05.220764 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-04bf848d-8a0b-4801-a759-2f5d0f093182 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:05.229730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-04bf848d-8a0b-4801-a759-2f5d0f093182 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:05.230527 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-04bf848d-8a0b-4801-a759-2f5d0f093182 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:05.231072 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-04bf848d-8a0b-4801-a759-2f5d0f093182 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:05.231566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-04bf848d-8a0b-4801-a759-2f5d0f093182 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:05.433551 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-04bf848d-8a0b-4801-a759-2f5d0f093182 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:05.442610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-04bf848d-8a0b-4801-a759-2f5d0f093182 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1317 microversion: 2.1 time: 0.226617 Apr 14 16:18:05.443354 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 502/1003] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:05 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:05.511259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-36074b0b-9afd-4ad1-8d2d-45910f520c82 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:05.512418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-36074b0b-9afd-4ad1-8d2d-45910f520c82 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:05.520570 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-36074b0b-9afd-4ad1-8d2d-45910f520c82 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:05.521096 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-36074b0b-9afd-4ad1-8d2d-45910f520c82 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:05.521973 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-36074b0b-9afd-4ad1-8d2d-45910f520c82 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:05.522470 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-36074b0b-9afd-4ad1-8d2d-45910f520c82 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:05.594029 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c825d040-846b-4394-8193-e7b18ca0dcab tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:05.595088 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c825d040-846b-4394-8193-e7b18ca0dcab tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:05.603305 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c825d040-846b-4394-8193-e7b18ca0dcab tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:05.604100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c825d040-846b-4394-8193-e7b18ca0dcab tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:05.605183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c825d040-846b-4394-8193-e7b18ca0dcab tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:05.605877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c825d040-846b-4394-8193-e7b18ca0dcab tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:05.641641 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-36074b0b-9afd-4ad1-8d2d-45910f520c82 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 31825 microversion: 2.1 time: 0.135287 Apr 14 16:18:05.647047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 502/1004] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:05 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 31825 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:18:05.816998 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c825d040-846b-4394-8193-e7b18ca0dcab tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:05.827311 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c825d040-846b-4394-8193-e7b18ca0dcab tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1265 microversion: 2.1 time: 0.238222 Apr 14 16:18:05.828160 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 503/1005] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:05 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:05.902325 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-79045b3b-d16d-43ae-8262-7d83538cb1c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:05.903142 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-79045b3b-d16d-43ae-8262-7d83538cb1c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:05.912089 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79045b3b-d16d-43ae-8262-7d83538cb1c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:05.912597 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79045b3b-d16d-43ae-8262-7d83538cb1c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:05.913473 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79045b3b-d16d-43ae-8262-7d83538cb1c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:05.914047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79045b3b-d16d-43ae-8262-7d83538cb1c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:06.115805 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-79045b3b-d16d-43ae-8262-7d83538cb1c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:06.128061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-79045b3b-d16d-43ae-8262-7d83538cb1c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:06.129845 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-79045b3b-d16d-43ae-8262-7d83538cb1c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:06.131101 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-79045b3b-d16d-43ae-8262-7d83538cb1c4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1723 microversion: 2.20 time: 0.233448 Apr 14 16:18:06.131911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 503/1006] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:05 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:06.242808 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-d4b76eaf-a95b-48c3-bee2-75ddbb6ce8ef req-ccc75d8d-310f-4db5-a4fe-b5eef2f4e28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9d7202-fd85-4ea1-951b-77525e2984be", "name": "network-vif-plugged", "status": "completed", "tag": "e78fae0b-8829-413f-93d4-0aa5119937a2"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:06.244427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:18:06.244427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:18:06.253550 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-d4b76eaf-a95b-48c3-bee2-75ddbb6ce8ef req-ccc75d8d-310f-4db5-a4fe-b5eef2f4e28a service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:06.254045 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-d4b76eaf-a95b-48c3-bee2-75ddbb6ce8ef req-ccc75d8d-310f-4db5-a4fe-b5eef2f4e28a service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:06.274831 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-d4b76eaf-a95b-48c3-bee2-75ddbb6ce8ef req-ccc75d8d-310f-4db5-a4fe-b5eef2f4e28a service nova] Creating event network-vif-plugged:e78fae0b-8829-413f-93d4-0aa5119937a2 for instance 7e9d7202-fd85-4ea1-951b-77525e2984be on hv-cinder-78626 Apr 14 16:18:06.280101 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-d4b76eaf-a95b-48c3-bee2-75ddbb6ce8ef req-ccc75d8d-310f-4db5-a4fe-b5eef2f4e28a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042145 Apr 14 16:18:06.281055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 504/1007] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:18:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:06.463471 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-251405e5-ef44-42a5-ab92-5893f5a5922e tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:06.464279 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-251405e5-ef44-42a5-ab92-5893f5a5922e tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:06.474488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-251405e5-ef44-42a5-ab92-5893f5a5922e tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:06.475119 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-251405e5-ef44-42a5-ab92-5893f5a5922e tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:06.476773 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-251405e5-ef44-42a5-ab92-5893f5a5922e tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:06.478027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-251405e5-ef44-42a5-ab92-5893f5a5922e tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:06.656727 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-137a1f44-7bdd-4a92-9cd1-8ca0498794f3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:06.658180 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-137a1f44-7bdd-4a92-9cd1-8ca0498794f3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:06.667006 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-137a1f44-7bdd-4a92-9cd1-8ca0498794f3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:06.668583 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-137a1f44-7bdd-4a92-9cd1-8ca0498794f3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:06.669498 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-137a1f44-7bdd-4a92-9cd1-8ca0498794f3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:06.670007 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-137a1f44-7bdd-4a92-9cd1-8ca0498794f3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:06.798955 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-251405e5-ef44-42a5-ab92-5893f5a5922e tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:06.802049 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-137a1f44-7bdd-4a92-9cd1-8ca0498794f3 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 32923 microversion: 2.1 time: 0.149637 Apr 14 16:18:06.803755 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 505/1008] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:06 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 32923 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:18:06.811224 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-251405e5-ef44-42a5-ab92-5893f5a5922e tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1317 microversion: 2.1 time: 0.353651 Apr 14 16:18:06.811864 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 504/1009] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:06 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:06.847167 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7cf85bef-b903-400a-ba81-5e73296db5bc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:06.847975 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7cf85bef-b903-400a-ba81-5e73296db5bc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:06.857867 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7cf85bef-b903-400a-ba81-5e73296db5bc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:06.858375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7cf85bef-b903-400a-ba81-5e73296db5bc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:06.859217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7cf85bef-b903-400a-ba81-5e73296db5bc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:06.859711 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7cf85bef-b903-400a-ba81-5e73296db5bc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:07.058552 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7cf85bef-b903-400a-ba81-5e73296db5bc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:07.067247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7cf85bef-b903-400a-ba81-5e73296db5bc tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1265 microversion: 2.1 time: 0.224608 Apr 14 16:18:07.067854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 506/1010] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:06 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:07.152278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2aa3fc76-2a5c-4f5c-820c-173539bca520 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:07.152989 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2aa3fc76-2a5c-4f5c-820c-173539bca520 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:07.161715 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2aa3fc76-2a5c-4f5c-820c-173539bca520 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:07.162222 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2aa3fc76-2a5c-4f5c-820c-173539bca520 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:07.163050 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2aa3fc76-2a5c-4f5c-820c-173539bca520 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:07.163534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2aa3fc76-2a5c-4f5c-820c-173539bca520 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:07.508992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2aa3fc76-2a5c-4f5c-820c-173539bca520 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:07.518603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2aa3fc76-2a5c-4f5c-820c-173539bca520 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:07.520452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2aa3fc76-2a5c-4f5c-820c-173539bca520 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:07.521826 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2aa3fc76-2a5c-4f5c-820c-173539bca520 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1723 microversion: 2.20 time: 0.374318 Apr 14 16:18:07.522441 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 505/1011] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:07 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1723 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:07.815199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a565dbb2-2f00-490a-a607-64b3f4b605c0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:07.816236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a565dbb2-2f00-490a-a607-64b3f4b605c0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:07.824437 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a565dbb2-2f00-490a-a607-64b3f4b605c0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:07.824957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a565dbb2-2f00-490a-a607-64b3f4b605c0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:07.825835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a565dbb2-2f00-490a-a607-64b3f4b605c0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:07.826332 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a565dbb2-2f00-490a-a607-64b3f4b605c0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:07.829160 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8cfbd009-ac36-4a4e-9a2b-702e7af9ac65 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:07.829866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8cfbd009-ac36-4a4e-9a2b-702e7af9ac65 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:07.837647 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8cfbd009-ac36-4a4e-9a2b-702e7af9ac65 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:07.838148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8cfbd009-ac36-4a4e-9a2b-702e7af9ac65 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:07.838982 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8cfbd009-ac36-4a4e-9a2b-702e7af9ac65 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:07.839464 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8cfbd009-ac36-4a4e-9a2b-702e7af9ac65 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:07.982247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a565dbb2-2f00-490a-a607-64b3f4b605c0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 33393 microversion: 2.1 time: 0.170948 Apr 14 16:18:07.987331 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 507/1012] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:07 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 33393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:18:08.040877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8cfbd009-ac36-4a4e-9a2b-702e7af9ac65 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:08.049978 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8cfbd009-ac36-4a4e-9a2b-702e7af9ac65 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1317 microversion: 2.1 time: 0.224741 Apr 14 16:18:08.050610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 506/1013] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:07 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:18:08.086866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7d7838f7-0da4-45fa-b493-0a1fb0224cd8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:08.087670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7d7838f7-0da4-45fa-b493-0a1fb0224cd8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:08.096392 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d7838f7-0da4-45fa-b493-0a1fb0224cd8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:08.096999 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d7838f7-0da4-45fa-b493-0a1fb0224cd8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:08.097956 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d7838f7-0da4-45fa-b493-0a1fb0224cd8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:08.098561 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d7838f7-0da4-45fa-b493-0a1fb0224cd8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:08.298024 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7d7838f7-0da4-45fa-b493-0a1fb0224cd8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:08.307281 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7d7838f7-0da4-45fa-b493-0a1fb0224cd8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1453 microversion: 2.1 time: 0.225661 Apr 14 16:18:08.307921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 508/1014] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:08 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1453 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:08.324350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-51867ab5-0a83-472c-8ad1-1406cf0120c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:08.325018 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-51867ab5-0a83-472c-8ad1-1406cf0120c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:08.332851 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-51867ab5-0a83-472c-8ad1-1406cf0120c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:08.333431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-51867ab5-0a83-472c-8ad1-1406cf0120c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:08.334272 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-51867ab5-0a83-472c-8ad1-1406cf0120c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:08.334762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-51867ab5-0a83-472c-8ad1-1406cf0120c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:08.337734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-0abe67a1-3011-4d93-bf88-4572b7623879 req-1b3b25d1-c58a-4a9e-8dac-8f2e00dd2896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ebf4fdb-09d1-44fa-b9ac-142842d75209", "name": "network-vif-plugged", "status": "completed", "tag": "b5f19e49-684a-45d4-875e-1398ffcf49b7"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:08.339401 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:18:08.339401 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:18:08.348587 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-0abe67a1-3011-4d93-bf88-4572b7623879 req-1b3b25d1-c58a-4a9e-8dac-8f2e00dd2896 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:08.349113 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-0abe67a1-3011-4d93-bf88-4572b7623879 req-1b3b25d1-c58a-4a9e-8dac-8f2e00dd2896 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:08.367201 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-0abe67a1-3011-4d93-bf88-4572b7623879 req-1b3b25d1-c58a-4a9e-8dac-8f2e00dd2896 service nova] Creating event network-vif-plugged:b5f19e49-684a-45d4-875e-1398ffcf49b7 for instance 1ebf4fdb-09d1-44fa-b9ac-142842d75209 on hv-cinder-78626 Apr 14 16:18:08.373919 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-0abe67a1-3011-4d93-bf88-4572b7623879 req-1b3b25d1-c58a-4a9e-8dac-8f2e00dd2896 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040758 Apr 14 16:18:08.374914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 509/1015] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:18:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:18:08.540667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-51867ab5-0a83-472c-8ad1-1406cf0120c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:08.544374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f7e640f6-aebb-4ebe-a85d-bfbd2c195abd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:08.545170 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f7e640f6-aebb-4ebe-a85d-bfbd2c195abd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:08.549921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-51867ab5-0a83-472c-8ad1-1406cf0120c8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1453 microversion: 2.1 time: 0.229509 Apr 14 16:18:08.550783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 507/1016] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:08 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1453 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:08.553383 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f7e640f6-aebb-4ebe-a85d-bfbd2c195abd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:08.553892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f7e640f6-aebb-4ebe-a85d-bfbd2c195abd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:08.554766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f7e640f6-aebb-4ebe-a85d-bfbd2c195abd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:08.555265 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f7e640f6-aebb-4ebe-a85d-bfbd2c195abd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:08.785504 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f7e640f6-aebb-4ebe-a85d-bfbd2c195abd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:08.795570 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f7e640f6-aebb-4ebe-a85d-bfbd2c195abd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:08.797280 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f7e640f6-aebb-4ebe-a85d-bfbd2c195abd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:08.798510 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f7e640f6-aebb-4ebe-a85d-bfbd2c195abd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1723 microversion: 2.20 time: 0.259817 Apr 14 16:18:08.799131 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 510/1017] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:08 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:18:08.995140 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9bf57210-e25c-44c6-80f0-c35cf592ef3d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:08.996379 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9bf57210-e25c-44c6-80f0-c35cf592ef3d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:09.004386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9bf57210-e25c-44c6-80f0-c35cf592ef3d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:09.004893 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9bf57210-e25c-44c6-80f0-c35cf592ef3d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:09.005768 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9bf57210-e25c-44c6-80f0-c35cf592ef3d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:09.006266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9bf57210-e25c-44c6-80f0-c35cf592ef3d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:09.068595 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-36306bc3-0a92-4813-879e-a46ff4d97662 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:09.069285 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-36306bc3-0a92-4813-879e-a46ff4d97662 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:09.078304 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-36306bc3-0a92-4813-879e-a46ff4d97662 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:09.078811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-36306bc3-0a92-4813-879e-a46ff4d97662 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:09.079656 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-36306bc3-0a92-4813-879e-a46ff4d97662 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:09.080149 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-36306bc3-0a92-4813-879e-a46ff4d97662 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:09.116462 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9bf57210-e25c-44c6-80f0-c35cf592ef3d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 33958 microversion: 2.1 time: 0.125113 Apr 14 16:18:09.122958 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 508/1018] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:08 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 33958 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:18:09.293281 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-36306bc3-0a92-4813-879e-a46ff4d97662 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:09.302059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-36306bc3-0a92-4813-879e-a46ff4d97662 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1317 microversion: 2.1 time: 0.237408 Apr 14 16:18:09.302730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 511/1019] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:09 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:09.820018 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fc481cca-1b58-4a91-8157-8be3a6737d15 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:09.821412 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fc481cca-1b58-4a91-8157-8be3a6737d15 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:09.829889 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fc481cca-1b58-4a91-8157-8be3a6737d15 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:09.830391 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fc481cca-1b58-4a91-8157-8be3a6737d15 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:09.831217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fc481cca-1b58-4a91-8157-8be3a6737d15 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:09.831701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fc481cca-1b58-4a91-8157-8be3a6737d15 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:10.128533 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fc481cca-1b58-4a91-8157-8be3a6737d15 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:10.130883 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cc4c91ec-d19a-465e-964b-fd305d0a15fe tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:10.131947 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cc4c91ec-d19a-465e-964b-fd305d0a15fe tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:10.141345 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cc4c91ec-d19a-465e-964b-fd305d0a15fe tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:10.141868 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cc4c91ec-d19a-465e-964b-fd305d0a15fe tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:10.142725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cc4c91ec-d19a-465e-964b-fd305d0a15fe tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:10.143229 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cc4c91ec-d19a-465e-964b-fd305d0a15fe tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:10.143737 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fc481cca-1b58-4a91-8157-8be3a6737d15 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:10.145458 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fc481cca-1b58-4a91-8157-8be3a6737d15 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:10.146695 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fc481cca-1b58-4a91-8157-8be3a6737d15 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1723 microversion: 2.20 time: 0.331514 Apr 14 16:18:10.147318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 509/1020] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:09 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:10.270596 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cc4c91ec-d19a-465e-964b-fd305d0a15fe tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 34446 microversion: 2.1 time: 0.143901 Apr 14 16:18:10.275044 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 512/1021] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:10 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 34446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:18:10.320990 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-adba721e-7ea1-4051-8444-45babe3d9614 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:10.321683 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-adba721e-7ea1-4051-8444-45babe3d9614 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:10.329669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-adba721e-7ea1-4051-8444-45babe3d9614 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:10.330176 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-adba721e-7ea1-4051-8444-45babe3d9614 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:10.331016 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-adba721e-7ea1-4051-8444-45babe3d9614 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:10.331505 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-adba721e-7ea1-4051-8444-45babe3d9614 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:10.755613 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-adba721e-7ea1-4051-8444-45babe3d9614 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:10.765346 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-adba721e-7ea1-4051-8444-45babe3d9614 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1506 microversion: 2.1 time: 0.449012 Apr 14 16:18:10.766070 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 510/1022] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:10 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:10.784713 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-442b55bf-239f-4885-8b56-f036ef5cca83 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cc5b8e5-b13d-4998-ac57-7f06c62a945f", "device": "/dev/sdb"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:10.786360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-442b55bf-239f-4885-8b56-f036ef5cca83 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:10.794916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-442b55bf-239f-4885-8b56-f036ef5cca83 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:10.795419 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-442b55bf-239f-4885-8b56-f036ef5cca83 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:10.796293 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-442b55bf-239f-4885-8b56-f036ef5cca83 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:10.796784 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-442b55bf-239f-4885-8b56-f036ef5cca83 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:11.166990 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4561ffca-8fcd-42a3-be7c-bc26def810e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:11.167541 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4561ffca-8fcd-42a3-be7c-bc26def810e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:11.176009 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4561ffca-8fcd-42a3-be7c-bc26def810e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:11.176513 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4561ffca-8fcd-42a3-be7c-bc26def810e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:11.177404 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4561ffca-8fcd-42a3-be7c-bc26def810e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:11.177897 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4561ffca-8fcd-42a3-be7c-bc26def810e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:11.191759 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-442b55bf-239f-4885-8b56-f036ef5cca83 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "POST /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.411900 Apr 14 16:18:11.192915 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 513/1023] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Apr 14 16:18:10 2021] POST /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:11.284217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-930b63db-e823-493a-a59b-498c95b0028f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:11.285447 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-930b63db-e823-493a-a59b-498c95b0028f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:11.295001 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-930b63db-e823-493a-a59b-498c95b0028f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:11.295522 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-930b63db-e823-493a-a59b-498c95b0028f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:11.296387 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-930b63db-e823-493a-a59b-498c95b0028f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:11.296886 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-930b63db-e823-493a-a59b-498c95b0028f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:11.431242 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-930b63db-e823-493a-a59b-498c95b0028f tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 35255 microversion: 2.1 time: 0.151710 Apr 14 16:18:11.433075 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 514/1024] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:11 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 35255 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:18:11.666680 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4561ffca-8fcd-42a3-be7c-bc26def810e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:11.676109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4561ffca-8fcd-42a3-be7c-bc26def810e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:11.677839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4561ffca-8fcd-42a3-be7c-bc26def810e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:11.679073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4561ffca-8fcd-42a3-be7c-bc26def810e7 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1723 microversion: 2.20 time: 0.516601 Apr 14 16:18:11.679702 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 511/1025] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:11 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1723 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:12.029570 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-9a166bdc-44e6-45b9-8a97-fe6e9b5ee7f3 req-c79d3ade-19aa-464a-a81a-bcda20222f23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e9d7202-fd85-4ea1-951b-77525e2984be", "tag": "e78fae0b-8829-413f-93d4-0aa5119937a2"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:12.032109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:18:12.032109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:18:12.041837 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-9a166bdc-44e6-45b9-8a97-fe6e9b5ee7f3 req-c79d3ade-19aa-464a-a81a-bcda20222f23 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:12.042339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-9a166bdc-44e6-45b9-8a97-fe6e9b5ee7f3 req-c79d3ade-19aa-464a-a81a-bcda20222f23 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:12.060146 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-9a166bdc-44e6-45b9-8a97-fe6e9b5ee7f3 req-c79d3ade-19aa-464a-a81a-bcda20222f23 service nova] Creating event network-changed:e78fae0b-8829-413f-93d4-0aa5119937a2 for instance 7e9d7202-fd85-4ea1-951b-77525e2984be on hv-cinder-78626 Apr 14 16:18:12.065345 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-9a166bdc-44e6-45b9-8a97-fe6e9b5ee7f3 req-c79d3ade-19aa-464a-a81a-bcda20222f23 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041432 Apr 14 16:18:12.066022 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 515/1026] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:18:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:12.444161 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-dbca9572-ca44-4a20-8e80-82dce4001c1d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:12.445716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-dbca9572-ca44-4a20-8e80-82dce4001c1d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:12.453921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dbca9572-ca44-4a20-8e80-82dce4001c1d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:12.454503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dbca9572-ca44-4a20-8e80-82dce4001c1d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:12.455644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dbca9572-ca44-4a20-8e80-82dce4001c1d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:12.456223 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dbca9572-ca44-4a20-8e80-82dce4001c1d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:12.580716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-dbca9572-ca44-4a20-8e80-82dce4001c1d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 35968 microversion: 2.1 time: 0.140355 Apr 14 16:18:12.585023 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 512/1027] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:12 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 35968 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:18:12.699863 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-54e1307e-3aa2-4187-b55d-32c49f716db5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:12.700824 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-54e1307e-3aa2-4187-b55d-32c49f716db5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:12.708835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54e1307e-3aa2-4187-b55d-32c49f716db5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:12.709395 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54e1307e-3aa2-4187-b55d-32c49f716db5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:12.710234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54e1307e-3aa2-4187-b55d-32c49f716db5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:12.711394 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-54e1307e-3aa2-4187-b55d-32c49f716db5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:12.915462 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-54e1307e-3aa2-4187-b55d-32c49f716db5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:12.928564 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-54e1307e-3aa2-4187-b55d-32c49f716db5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:12.931616 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-54e1307e-3aa2-4187-b55d-32c49f716db5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:12.933954 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-54e1307e-3aa2-4187-b55d-32c49f716db5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1723 microversion: 2.20 time: 0.238863 Apr 14 16:18:12.935357 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 516/1028] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:12 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:13.593359 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-609016ec-3be8-4ff2-850e-0a8f2fea49de tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:13.594509 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-609016ec-3be8-4ff2-850e-0a8f2fea49de tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:13.603333 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-609016ec-3be8-4ff2-850e-0a8f2fea49de tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:13.603839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-609016ec-3be8-4ff2-850e-0a8f2fea49de tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:13.604685 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-609016ec-3be8-4ff2-850e-0a8f2fea49de tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:13.605235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-609016ec-3be8-4ff2-850e-0a8f2fea49de tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:13.719700 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-609016ec-3be8-4ff2-850e-0a8f2fea49de tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 37003 microversion: 2.1 time: 0.130838 Apr 14 16:18:13.720426 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 513/1029] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:13 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 37003 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:18:13.955563 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ccd3678e-849a-410d-b178-5827ce48e729 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:13.956230 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ccd3678e-849a-410d-b178-5827ce48e729 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:13.964641 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccd3678e-849a-410d-b178-5827ce48e729 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:13.965194 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccd3678e-849a-410d-b178-5827ce48e729 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:13.966022 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccd3678e-849a-410d-b178-5827ce48e729 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:13.966510 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccd3678e-849a-410d-b178-5827ce48e729 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:14.164771 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ccd3678e-849a-410d-b178-5827ce48e729 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:14.174135 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ccd3678e-849a-410d-b178-5827ce48e729 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:14.175814 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ccd3678e-849a-410d-b178-5827ce48e729 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:14.177029 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ccd3678e-849a-410d-b178-5827ce48e729 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1723 microversion: 2.20 time: 0.225667 Apr 14 16:18:14.177702 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 517/1030] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:13 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:14.732913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ec25c69b-b7dc-43a2-8914-ad6ffbc0cd49 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:14.734116 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ec25c69b-b7dc-43a2-8914-ad6ffbc0cd49 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:14.742684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ec25c69b-b7dc-43a2-8914-ad6ffbc0cd49 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:14.743186 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ec25c69b-b7dc-43a2-8914-ad6ffbc0cd49 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:14.744011 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ec25c69b-b7dc-43a2-8914-ad6ffbc0cd49 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:14.744494 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ec25c69b-b7dc-43a2-8914-ad6ffbc0cd49 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:14.935505 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ec25c69b-b7dc-43a2-8914-ad6ffbc0cd49 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 37911 microversion: 2.1 time: 0.207096 Apr 14 16:18:14.936192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 514/1031] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:14 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 37911 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:18:15.197678 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-984cadd8-e432-48ef-9548-bdaab3f5a1ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:15.198344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-984cadd8-e432-48ef-9548-bdaab3f5a1ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:15.206173 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-984cadd8-e432-48ef-9548-bdaab3f5a1ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:15.206678 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-984cadd8-e432-48ef-9548-bdaab3f5a1ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:15.207512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-984cadd8-e432-48ef-9548-bdaab3f5a1ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:15.208005 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-984cadd8-e432-48ef-9548-bdaab3f5a1ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:15.408612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-984cadd8-e432-48ef-9548-bdaab3f5a1ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:15.418805 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-984cadd8-e432-48ef-9548-bdaab3f5a1ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:15.420478 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-984cadd8-e432-48ef-9548-bdaab3f5a1ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:15.421724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-984cadd8-e432-48ef-9548-bdaab3f5a1ed tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1744 microversion: 2.20 time: 0.228809 Apr 14 16:18:15.422341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 518/1032] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:15 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1744 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:15.950127 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ad6f36b5-3b7f-4d2e-b786-5ad8e4ad79e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:15.951330 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ad6f36b5-3b7f-4d2e-b786-5ad8e4ad79e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:15.960068 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ad6f36b5-3b7f-4d2e-b786-5ad8e4ad79e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:15.960577 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ad6f36b5-3b7f-4d2e-b786-5ad8e4ad79e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:15.961439 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ad6f36b5-3b7f-4d2e-b786-5ad8e4ad79e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:15.961946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ad6f36b5-3b7f-4d2e-b786-5ad8e4ad79e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:16.076339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ad6f36b5-3b7f-4d2e-b786-5ad8e4ad79e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 38176 microversion: 2.1 time: 0.131251 Apr 14 16:18:16.080619 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 515/1033] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:15 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 38176 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:18:16.442389 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-13f1810d-ebe4-4ad5-8146-50a30d6ef026 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:16.443139 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-13f1810d-ebe4-4ad5-8146-50a30d6ef026 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:16.452427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-13f1810d-ebe4-4ad5-8146-50a30d6ef026 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:16.452938 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-13f1810d-ebe4-4ad5-8146-50a30d6ef026 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:16.453812 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-13f1810d-ebe4-4ad5-8146-50a30d6ef026 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:16.454305 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-13f1810d-ebe4-4ad5-8146-50a30d6ef026 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:16.652278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-13f1810d-ebe4-4ad5-8146-50a30d6ef026 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:16.661961 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-13f1810d-ebe4-4ad5-8146-50a30d6ef026 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:16.663780 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-13f1810d-ebe4-4ad5-8146-50a30d6ef026 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:16.665025 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-13f1810d-ebe4-4ad5-8146-50a30d6ef026 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1744 microversion: 2.20 time: 0.226766 Apr 14 16:18:16.665675 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 519/1034] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:16 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1744 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:17.089943 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-df4a12b4-40eb-4c4f-87c5-23dc0900cd62 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:17.091097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-df4a12b4-40eb-4c4f-87c5-23dc0900cd62 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:17.099762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df4a12b4-40eb-4c4f-87c5-23dc0900cd62 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:17.100272 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df4a12b4-40eb-4c4f-87c5-23dc0900cd62 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:17.101738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df4a12b4-40eb-4c4f-87c5-23dc0900cd62 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:17.102241 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-df4a12b4-40eb-4c4f-87c5-23dc0900cd62 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:17.233027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-df4a12b4-40eb-4c4f-87c5-23dc0900cd62 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 38176 microversion: 2.1 time: 0.147898 Apr 14 16:18:17.233886 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 516/1035] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:17 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 38176 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:18:17.684199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-682c3441-4c6d-471e-b870-96c5175aa9d0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:17.684870 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-682c3441-4c6d-471e-b870-96c5175aa9d0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:17.692904 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-682c3441-4c6d-471e-b870-96c5175aa9d0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:17.693451 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-682c3441-4c6d-471e-b870-96c5175aa9d0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:17.694310 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-682c3441-4c6d-471e-b870-96c5175aa9d0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:17.695412 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-682c3441-4c6d-471e-b870-96c5175aa9d0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:17.899043 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-682c3441-4c6d-471e-b870-96c5175aa9d0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:17.909590 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-682c3441-4c6d-471e-b870-96c5175aa9d0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:17.911302 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-682c3441-4c6d-471e-b870-96c5175aa9d0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:17.912666 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-682c3441-4c6d-471e-b870-96c5175aa9d0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1744 microversion: 2.20 time: 0.232573 Apr 14 16:18:17.913339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 520/1036] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:17 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1744 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:18.229465 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-cdd52b9d-baee-4784-978d-0e68d0d6bb77 req-ffcdab15-2ac9-47da-ae38-35fd7219f06b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e45e06-d4ec-48d7-8576-da008e2a2bbe", "name": "network-vif-plugged", "status": "completed", "tag": "86985f08-70cd-4417-8f18-ff0ada9a82ff"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:18.231990 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:18:18.231990 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:18:18.246573 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1bcf7aab-0e95-4174-9df8-b9a5b813d770 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:18.247826 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1bcf7aab-0e95-4174-9df8-b9a5b813d770 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:18.259512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-cdd52b9d-baee-4784-978d-0e68d0d6bb77 req-ffcdab15-2ac9-47da-ae38-35fd7219f06b service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:18.261500 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1bcf7aab-0e95-4174-9df8-b9a5b813d770 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:18.262019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-cdd52b9d-baee-4784-978d-0e68d0d6bb77 req-ffcdab15-2ac9-47da-ae38-35fd7219f06b service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:18.267071 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1bcf7aab-0e95-4174-9df8-b9a5b813d770 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:18.268512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1bcf7aab-0e95-4174-9df8-b9a5b813d770 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:18.269274 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1bcf7aab-0e95-4174-9df8-b9a5b813d770 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:18.280836 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-cdd52b9d-baee-4784-978d-0e68d0d6bb77 req-ffcdab15-2ac9-47da-ae38-35fd7219f06b service nova] Creating event network-vif-plugged:86985f08-70cd-4417-8f18-ff0ada9a82ff for instance 67e45e06-d4ec-48d7-8576-da008e2a2bbe on hv-cinder-78626 Apr 14 16:18:18.286554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-cdd52b9d-baee-4784-978d-0e68d0d6bb77 req-ffcdab15-2ac9-47da-ae38-35fd7219f06b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062423 Apr 14 16:18:18.287771 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 517/1037] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:18:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:18.436762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1bcf7aab-0e95-4174-9df8-b9a5b813d770 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action" status: 200 len: 38307 microversion: 2.1 time: 0.194295 Apr 14 16:18:18.437823 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 521/1038] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:18:18 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/action => generated 38307 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:18:18.449609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-99e0e343-b917-472a-90db-cdf1536b5243 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:18.450297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-99e0e343-b917-472a-90db-cdf1536b5243 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:18.458512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-99e0e343-b917-472a-90db-cdf1536b5243 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:18.459302 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-99e0e343-b917-472a-90db-cdf1536b5243 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:18.460144 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-99e0e343-b917-472a-90db-cdf1536b5243 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:18.460971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-99e0e343-b917-472a-90db-cdf1536b5243 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:18.522623 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-99e0e343-b917-472a-90db-cdf1536b5243 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/ips" status: 200 len: 145 microversion: 2.1 time: 0.077995 Apr 14 16:18:18.523385 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 518/1039] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Apr 14 16:18:18 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/ips => generated 145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:18.934944 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-95f3df1e-6c51-4448-80f5-8020cf611681 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:18.936089 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-95f3df1e-6c51-4448-80f5-8020cf611681 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:18.958958 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-95f3df1e-6c51-4448-80f5-8020cf611681 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:18.963838 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-95f3df1e-6c51-4448-80f5-8020cf611681 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:18.965183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-95f3df1e-6c51-4448-80f5-8020cf611681 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:18.965966 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-95f3df1e-6c51-4448-80f5-8020cf611681 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:19.250054 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-95f3df1e-6c51-4448-80f5-8020cf611681 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:19.264313 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-95f3df1e-6c51-4448-80f5-8020cf611681 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:19.266120 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-95f3df1e-6c51-4448-80f5-8020cf611681 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:19.268540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-95f3df1e-6c51-4448-80f5-8020cf611681 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1739 microversion: 2.20 time: 0.339267 Apr 14 16:18:19.268540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 522/1040] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:18 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1739 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:20.128537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3e5bfb0a-9c0c-4a56-b71d-786124aa11b1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d91e9244-b4f9-48bf-84a7-6310d1cb1293"}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:20.132306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3e5bfb0a-9c0c-4a56-b71d-786124aa11b1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:20.146304 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e5bfb0a-9c0c-4a56-b71d-786124aa11b1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:20.146822 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e5bfb0a-9c0c-4a56-b71d-786124aa11b1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:20.148431 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e5bfb0a-9c0c-4a56-b71d-786124aa11b1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:20.148753 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e5bfb0a-9c0c-4a56-b71d-786124aa11b1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:20.287720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-888bbd92-659b-4650-9606-43bbd3124e87 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:20.288294 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-888bbd92-659b-4650-9606-43bbd3124e87 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:20.302465 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-888bbd92-659b-4650-9606-43bbd3124e87 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:20.303386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-888bbd92-659b-4650-9606-43bbd3124e87 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:20.305414 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-888bbd92-659b-4650-9606-43bbd3124e87 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:20.306083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-888bbd92-659b-4650-9606-43bbd3124e87 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:20.536143 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-888bbd92-659b-4650-9606-43bbd3124e87 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:20.546638 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-888bbd92-659b-4650-9606-43bbd3124e87 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:20.548239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-888bbd92-659b-4650-9606-43bbd3124e87 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:20.549706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-888bbd92-659b-4650-9606-43bbd3124e87 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1739 microversion: 2.20 time: 0.266187 Apr 14 16:18:20.550513 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 523/1041] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:20 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:18:21.569798 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-98caad0a-4490-48c4-b283-b69fa427bdf0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:21.571433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-98caad0a-4490-48c4-b283-b69fa427bdf0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:21.580104 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-98caad0a-4490-48c4-b283-b69fa427bdf0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:21.580719 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-98caad0a-4490-48c4-b283-b69fa427bdf0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:21.581846 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-98caad0a-4490-48c4-b283-b69fa427bdf0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:21.582395 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-98caad0a-4490-48c4-b283-b69fa427bdf0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:21.789552 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-98caad0a-4490-48c4-b283-b69fa427bdf0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:21.800102 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-98caad0a-4490-48c4-b283-b69fa427bdf0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:21.801987 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-98caad0a-4490-48c4-b283-b69fa427bdf0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:21.803323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-98caad0a-4490-48c4-b283-b69fa427bdf0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1739 microversion: 2.20 time: 0.237625 Apr 14 16:18:21.804729 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 524/1042] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:21 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:18:22.825564 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3c4baa5a-e0cd-46b4-900b-6500e343d97c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:22.826245 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3c4baa5a-e0cd-46b4-900b-6500e343d97c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:22.838832 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c4baa5a-e0cd-46b4-900b-6500e343d97c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:22.839688 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c4baa5a-e0cd-46b4-900b-6500e343d97c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:22.840858 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c4baa5a-e0cd-46b4-900b-6500e343d97c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:22.841621 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c4baa5a-e0cd-46b4-900b-6500e343d97c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:23.108882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3c4baa5a-e0cd-46b4-900b-6500e343d97c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:23.119425 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3c4baa5a-e0cd-46b4-900b-6500e343d97c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:23.121317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3c4baa5a-e0cd-46b4-900b-6500e343d97c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:23.123178 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3c4baa5a-e0cd-46b4-900b-6500e343d97c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1739 microversion: 2.20 time: 0.301312 Apr 14 16:18:23.123178 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 525/1043] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:22 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:18:23.903797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3e5bfb0a-9c0c-4a56-b71d-786124aa11b1 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.779205 Apr 14 16:18:23.910750 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 519/1044] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Apr 14 16:18:20 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments => generated 194 bytes in 3787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:24.147286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e815d064-a174-49bf-8214-0ae66982f3cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:24.148946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e815d064-a174-49bf-8214-0ae66982f3cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:24.158586 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e815d064-a174-49bf-8214-0ae66982f3cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:24.159256 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e815d064-a174-49bf-8214-0ae66982f3cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:24.160298 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e815d064-a174-49bf-8214-0ae66982f3cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:24.160889 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e815d064-a174-49bf-8214-0ae66982f3cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:24.398644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e815d064-a174-49bf-8214-0ae66982f3cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:24.410565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e815d064-a174-49bf-8214-0ae66982f3cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:24.412823 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e815d064-a174-49bf-8214-0ae66982f3cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:24.414215 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e815d064-a174-49bf-8214-0ae66982f3cd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1739 microversion: 2.20 time: 0.271237 Apr 14 16:18:24.426654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 526/1045] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:24 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:25.436177 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-49f443b1-be7a-4b86-8de4-e386621c5973 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:25.437106 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-49f443b1-be7a-4b86-8de4-e386621c5973 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:25.451896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49f443b1-be7a-4b86-8de4-e386621c5973 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:25.452410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49f443b1-be7a-4b86-8de4-e386621c5973 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:25.453294 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49f443b1-be7a-4b86-8de4-e386621c5973 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:25.453965 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49f443b1-be7a-4b86-8de4-e386621c5973 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:25.673192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-49f443b1-be7a-4b86-8de4-e386621c5973 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:25.685269 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-49f443b1-be7a-4b86-8de4-e386621c5973 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:25.686304 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-49f443b1-be7a-4b86-8de4-e386621c5973 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:25.687511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-49f443b1-be7a-4b86-8de4-e386621c5973 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1739 microversion: 2.20 time: 0.256690 Apr 14 16:18:25.688317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 520/1046] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:25 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1739 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:18:26.708339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cbdc5d1d-a7d3-412c-9bea-33d00fc2ed3c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:26.709303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cbdc5d1d-a7d3-412c-9bea-33d00fc2ed3c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:26.718011 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbdc5d1d-a7d3-412c-9bea-33d00fc2ed3c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:26.718683 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbdc5d1d-a7d3-412c-9bea-33d00fc2ed3c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:26.719629 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbdc5d1d-a7d3-412c-9bea-33d00fc2ed3c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:26.720192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cbdc5d1d-a7d3-412c-9bea-33d00fc2ed3c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:26.963743 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cbdc5d1d-a7d3-412c-9bea-33d00fc2ed3c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:26.973618 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cbdc5d1d-a7d3-412c-9bea-33d00fc2ed3c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:26.975304 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-cbdc5d1d-a7d3-412c-9bea-33d00fc2ed3c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:26.977134 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cbdc5d1d-a7d3-412c-9bea-33d00fc2ed3c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1739 microversion: 2.20 time: 0.273337 Apr 14 16:18:26.977769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 527/1047] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:26 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1739 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:27.997440 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bd57bd32-1d54-40d6-8ddd-39a9d7c7f04f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:27.998826 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bd57bd32-1d54-40d6-8ddd-39a9d7c7f04f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:28.007339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd57bd32-1d54-40d6-8ddd-39a9d7c7f04f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:28.007988 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd57bd32-1d54-40d6-8ddd-39a9d7c7f04f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:28.008819 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd57bd32-1d54-40d6-8ddd-39a9d7c7f04f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:28.009333 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd57bd32-1d54-40d6-8ddd-39a9d7c7f04f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:28.210751 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bd57bd32-1d54-40d6-8ddd-39a9d7c7f04f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:28.220165 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bd57bd32-1d54-40d6-8ddd-39a9d7c7f04f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:28.221865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bd57bd32-1d54-40d6-8ddd-39a9d7c7f04f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:28.223085 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bd57bd32-1d54-40d6-8ddd-39a9d7c7f04f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1739 microversion: 2.20 time: 0.229838 Apr 14 16:18:28.223697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 521/1048] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:27 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:29.244012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f38a72cf-6402-4bba-b5a3-8014f4e082e3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:29.246449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f38a72cf-6402-4bba-b5a3-8014f4e082e3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:29.252491 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f38a72cf-6402-4bba-b5a3-8014f4e082e3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:29.252994 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f38a72cf-6402-4bba-b5a3-8014f4e082e3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:29.254887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f38a72cf-6402-4bba-b5a3-8014f4e082e3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:29.255383 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f38a72cf-6402-4bba-b5a3-8014f4e082e3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:29.454382 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f38a72cf-6402-4bba-b5a3-8014f4e082e3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:29.464051 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f38a72cf-6402-4bba-b5a3-8014f4e082e3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:29.465807 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f38a72cf-6402-4bba-b5a3-8014f4e082e3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:29.467046 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f38a72cf-6402-4bba-b5a3-8014f4e082e3 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1739 microversion: 2.20 time: 0.227885 Apr 14 16:18:29.467839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 528/1049] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:29 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:30.487739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d0633d88-15df-414f-8217-896bc1c85153 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:30.488428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d0633d88-15df-414f-8217-896bc1c85153 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:30.497096 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d0633d88-15df-414f-8217-896bc1c85153 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:30.497637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d0633d88-15df-414f-8217-896bc1c85153 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:30.498483 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d0633d88-15df-414f-8217-896bc1c85153 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:30.498969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d0633d88-15df-414f-8217-896bc1c85153 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:30.701494 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d0633d88-15df-414f-8217-896bc1c85153 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:30.711407 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d0633d88-15df-414f-8217-896bc1c85153 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:30.713119 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d0633d88-15df-414f-8217-896bc1c85153 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:30.714453 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d0633d88-15df-414f-8217-896bc1c85153 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1721 microversion: 2.20 time: 0.230980 Apr 14 16:18:30.715063 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 522/1050] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:30 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:31.734368 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1bbf0171-dc42-4feb-b3fb-6712e6fda0ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:31.735053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1bbf0171-dc42-4feb-b3fb-6712e6fda0ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:31.743557 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1bbf0171-dc42-4feb-b3fb-6712e6fda0ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:31.744074 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1bbf0171-dc42-4feb-b3fb-6712e6fda0ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:31.744930 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1bbf0171-dc42-4feb-b3fb-6712e6fda0ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:31.745513 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1bbf0171-dc42-4feb-b3fb-6712e6fda0ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:31.838197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e7aa0951-f7e3-43c0-9091-afffd6a349e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:31.839316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e7aa0951-f7e3-43c0-9091-afffd6a349e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:31.847324 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e7aa0951-f7e3-43c0-9091-afffd6a349e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:31.847683 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e7aa0951-f7e3-43c0-9091-afffd6a349e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:31.848519 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e7aa0951-f7e3-43c0-9091-afffd6a349e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:31.849003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e7aa0951-f7e3-43c0-9091-afffd6a349e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:31.922423 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e7aa0951-f7e3-43c0-9091-afffd6a349e4 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088337 Apr 14 16:18:31.923092 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 523/1051] 10.222.0.60 () {58 vars in 1292 bytes} [Wed Apr 14 16:18:31 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:31.936535 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-89e79ace-10c8-494f-b268-35ee03bb2290 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:31.937164 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-89e79ace-10c8-494f-b268-35ee03bb2290 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:31.945157 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-89e79ace-10c8-494f-b268-35ee03bb2290 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:31.945674 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-89e79ace-10c8-494f-b268-35ee03bb2290 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:31.946524 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-89e79ace-10c8-494f-b268-35ee03bb2290 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:31.947020 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-89e79ace-10c8-494f-b268-35ee03bb2290 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:31.951501 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1bbf0171-dc42-4feb-b3fb-6712e6fda0ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:31.961734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1bbf0171-dc42-4feb-b3fb-6712e6fda0ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:31.963417 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1bbf0171-dc42-4feb-b3fb-6712e6fda0ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:31.964643 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1bbf0171-dc42-4feb-b3fb-6712e6fda0ff tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1721 microversion: 2.20 time: 0.234351 Apr 14 16:18:31.965288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 529/1052] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:31 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:32.015971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-89e79ace-10c8-494f-b268-35ee03bb2290 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments/d91e9244-b4f9-48bf-84a7-6310d1cb1293" status: 200 len: 194 microversion: 2.1 time: 0.085495 Apr 14 16:18:32.016549 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 524/1053] 10.222.0.60 () {58 vars in 1403 bytes} [Wed Apr 14 16:18:31 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments/d91e9244-b4f9-48bf-84a7-6310d1cb1293 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:18:32.214576 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-8759a26f-7f5a-4725-967d-484e025d96e0 req-3b07aace-197a-45a4-ac47-9a8ee5b63626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e45e06-d4ec-48d7-8576-da008e2a2bbe", "name": "network-vif-unplugged", "status": "completed", "tag": "86985f08-70cd-4417-8f18-ff0ada9a82ff"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:32.216488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:18:32.216488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:18:32.226347 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-8759a26f-7f5a-4725-967d-484e025d96e0 req-3b07aace-197a-45a4-ac47-9a8ee5b63626 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:32.227145 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-8759a26f-7f5a-4725-967d-484e025d96e0 req-3b07aace-197a-45a4-ac47-9a8ee5b63626 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:32.244901 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-8759a26f-7f5a-4725-967d-484e025d96e0 req-3b07aace-197a-45a4-ac47-9a8ee5b63626 service nova] Creating event network-vif-unplugged:86985f08-70cd-4417-8f18-ff0ada9a82ff for instance 67e45e06-d4ec-48d7-8576-da008e2a2bbe on hv-cinder-78626 Apr 14 16:18:32.250294 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-8759a26f-7f5a-4725-967d-484e025d96e0 req-3b07aace-197a-45a4-ac47-9a8ee5b63626 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040165 Apr 14 16:18:32.251218 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 530/1054] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:18:32 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:32.985246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-216371c4-423b-4207-a989-d6e6c5894bda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:32.985962 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-216371c4-423b-4207-a989-d6e6c5894bda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:32.994498 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-216371c4-423b-4207-a989-d6e6c5894bda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:32.995012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-216371c4-423b-4207-a989-d6e6c5894bda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:32.995852 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-216371c4-423b-4207-a989-d6e6c5894bda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:32.996350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-216371c4-423b-4207-a989-d6e6c5894bda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:33.197699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-216371c4-423b-4207-a989-d6e6c5894bda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:33.207447 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-216371c4-423b-4207-a989-d6e6c5894bda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:33.209189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-216371c4-423b-4207-a989-d6e6c5894bda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:33.210571 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-216371c4-423b-4207-a989-d6e6c5894bda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1721 microversion: 2.20 time: 0.229709 Apr 14 16:18:33.211234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 525/1055] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:32 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:33.533218 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7fa21b84-5d33-4864-b50a-5db28c8b9632 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "536ebb4f-e4db-4786-9af3-11e7c7f6ddf2"}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:33.534595 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7fa21b84-5d33-4864-b50a-5db28c8b9632 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:33.543306 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7fa21b84-5d33-4864-b50a-5db28c8b9632 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:33.543811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7fa21b84-5d33-4864-b50a-5db28c8b9632 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:33.544643 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7fa21b84-5d33-4864-b50a-5db28c8b9632 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:33.545163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7fa21b84-5d33-4864-b50a-5db28c8b9632 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:33.760880 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-dfc02512-0104-4df3-be14-1f3e36464b12 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:33.761456 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-dfc02512-0104-4df3-be14-1f3e36464b12 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:33.769466 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dfc02512-0104-4df3-be14-1f3e36464b12 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:33.769926 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dfc02512-0104-4df3-be14-1f3e36464b12 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:33.770776 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dfc02512-0104-4df3-be14-1f3e36464b12 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:33.771272 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dfc02512-0104-4df3-be14-1f3e36464b12 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:33.942484 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7fa21b84-5d33-4864-b50a-5db28c8b9632 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413998 Apr 14 16:18:33.943448 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 531/1056] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Apr 14 16:18:33 2021] POST /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:33.961544 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-dfc02512-0104-4df3-be14-1f3e36464b12 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lazy-loading 'services' on Instance uuid 1ebf4fdb-09d1-44fa-b9ac-142842d75209 {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:18:34.135294 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-dfc02512-0104-4df3-be14-1f3e36464b12 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209/os-volume_attachments/2cc5b8e5-b13d-4998-ac57-7f06c62a945f" status: 202 len: 0 microversion: 2.1 time: 0.378700 Apr 14 16:18:34.135954 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 526/1057] 10.222.0.60 () {58 vars in 1406 bytes} [Wed Apr 14 16:18:33 2021] DELETE /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209/os-volume_attachments/2cc5b8e5-b13d-4998-ac57-7f06c62a945f => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:18:34.231960 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e1ee74c5-1717-49b5-9c6f-0ce850fd8b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:34.232730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e1ee74c5-1717-49b5-9c6f-0ce850fd8b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:34.241851 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e1ee74c5-1717-49b5-9c6f-0ce850fd8b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:34.242333 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e1ee74c5-1717-49b5-9c6f-0ce850fd8b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:34.243367 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e1ee74c5-1717-49b5-9c6f-0ce850fd8b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:34.244014 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e1ee74c5-1717-49b5-9c6f-0ce850fd8b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:34.442415 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e1ee74c5-1717-49b5-9c6f-0ce850fd8b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:34.452273 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e1ee74c5-1717-49b5-9c6f-0ce850fd8b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:34.453968 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e1ee74c5-1717-49b5-9c6f-0ce850fd8b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:34.455177 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e1ee74c5-1717-49b5-9c6f-0ce850fd8b04 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1664 microversion: 2.20 time: 0.228482 Apr 14 16:18:34.455795 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 532/1058] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:34 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1664 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:34.474692 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bcb52c07-61da-40dd-8348-279059a8136a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14d8b559-4118-481c-92c2-a539cb71e996"}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:34.476263 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bcb52c07-61da-40dd-8348-279059a8136a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:34.485098 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bcb52c07-61da-40dd-8348-279059a8136a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:34.485619 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bcb52c07-61da-40dd-8348-279059a8136a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:34.486424 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bcb52c07-61da-40dd-8348-279059a8136a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:34.486908 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bcb52c07-61da-40dd-8348-279059a8136a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:34.915035 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bcb52c07-61da-40dd-8348-279059a8136a tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.444892 Apr 14 16:18:34.915708 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 527/1059] 10.222.0.60 () {62 vars in 1354 bytes} [Wed Apr 14 16:18:34 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/os-volume_attachments => generated 188 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:18:35.026895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-5a3f317f-1c6b-460d-a92e-ffcc77a66caf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:35.027440 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-5a3f317f-1c6b-460d-a92e-ffcc77a66caf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:35.036131 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a3f317f-1c6b-460d-a92e-ffcc77a66caf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:35.036637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a3f317f-1c6b-460d-a92e-ffcc77a66caf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:35.037497 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a3f317f-1c6b-460d-a92e-ffcc77a66caf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:35.037987 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-5a3f317f-1c6b-460d-a92e-ffcc77a66caf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:35.573673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-5a3f317f-1c6b-460d-a92e-ffcc77a66caf tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "DELETE /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/os-volume_attachments/14d8b559-4118-481c-92c2-a539cb71e996" status: 202 len: 0 microversion: 2.20 time: 0.551177 Apr 14 16:18:35.574351 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 533/1060] 10.222.0.60 () {60 vars in 1447 bytes} [Wed Apr 14 16:18:35 2021] DELETE /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/os-volume_attachments/14d8b559-4118-481c-92c2-a539cb71e996 => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 14 16:18:35.678308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4e9bba46-bd6a-4a80-8baf-59e68f270032 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:35.679071 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4e9bba46-bd6a-4a80-8baf-59e68f270032 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:35.687318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4e9bba46-bd6a-4a80-8baf-59e68f270032 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:35.687813 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4e9bba46-bd6a-4a80-8baf-59e68f270032 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:35.688635 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4e9bba46-bd6a-4a80-8baf-59e68f270032 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:35.689148 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4e9bba46-bd6a-4a80-8baf-59e68f270032 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:35.840442 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4e9bba46-bd6a-4a80-8baf-59e68f270032 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action" status: 202 len: 0 microversion: 2.20 time: 0.166077 Apr 14 16:18:35.841024 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 528/1061] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Apr 14 16:18:35 2021] POST /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:18:35.850122 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a4199b83-6910-486e-a1f4-e8b1252e4b35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:35.851464 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a4199b83-6910-486e-a1f4-e8b1252e4b35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:35.859700 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4199b83-6910-486e-a1f4-e8b1252e4b35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:35.860217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4199b83-6910-486e-a1f4-e8b1252e4b35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:35.861153 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4199b83-6910-486e-a1f4-e8b1252e4b35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:35.861664 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4199b83-6910-486e-a1f4-e8b1252e4b35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:36.146307 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a4199b83-6910-486e-a1f4-e8b1252e4b35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:36.156235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a4199b83-6910-486e-a1f4-e8b1252e4b35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:36.158395 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a4199b83-6910-486e-a1f4-e8b1252e4b35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:36.159639 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a4199b83-6910-486e-a1f4-e8b1252e4b35 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1672 microversion: 2.20 time: 0.314059 Apr 14 16:18:36.160244 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 534/1062] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:35 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1672 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:37.180006 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-041e8c57-ec5f-4d73-8aae-ff36404ce717 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:37.180612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-041e8c57-ec5f-4d73-8aae-ff36404ce717 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:37.188583 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-041e8c57-ec5f-4d73-8aae-ff36404ce717 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:37.189145 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-041e8c57-ec5f-4d73-8aae-ff36404ce717 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:37.189999 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-041e8c57-ec5f-4d73-8aae-ff36404ce717 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:37.190492 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-041e8c57-ec5f-4d73-8aae-ff36404ce717 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:37.581959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-041e8c57-ec5f-4d73-8aae-ff36404ce717 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:37.591826 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-041e8c57-ec5f-4d73-8aae-ff36404ce717 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:37.593592 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-041e8c57-ec5f-4d73-8aae-ff36404ce717 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:37.594816 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-041e8c57-ec5f-4d73-8aae-ff36404ce717 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1674 microversion: 2.20 time: 0.419163 Apr 14 16:18:37.595445 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 529/1063] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:37 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1674 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:38.615944 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-084b1320-9594-4426-9b7d-f7621e67b3d6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:38.617069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-084b1320-9594-4426-9b7d-f7621e67b3d6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:38.636607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-084b1320-9594-4426-9b7d-f7621e67b3d6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:38.638497 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-084b1320-9594-4426-9b7d-f7621e67b3d6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:38.641957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-084b1320-9594-4426-9b7d-f7621e67b3d6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:38.642832 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-084b1320-9594-4426-9b7d-f7621e67b3d6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:38.883106 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-084b1320-9594-4426-9b7d-f7621e67b3d6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:38.892652 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-084b1320-9594-4426-9b7d-f7621e67b3d6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:38.894377 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-084b1320-9594-4426-9b7d-f7621e67b3d6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:38.895610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-084b1320-9594-4426-9b7d-f7621e67b3d6 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.284202 Apr 14 16:18:38.896233 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 535/1064] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:38 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:39.916375 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ae45cef7-572c-4820-9630-f781054f3086 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:39.917907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ae45cef7-572c-4820-9630-f781054f3086 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:39.926795 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ae45cef7-572c-4820-9630-f781054f3086 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:39.927399 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ae45cef7-572c-4820-9630-f781054f3086 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:39.928329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ae45cef7-572c-4820-9630-f781054f3086 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:39.928942 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ae45cef7-572c-4820-9630-f781054f3086 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:40.148932 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ae45cef7-572c-4820-9630-f781054f3086 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:40.158645 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ae45cef7-572c-4820-9630-f781054f3086 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:40.160338 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ae45cef7-572c-4820-9630-f781054f3086 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:40.161608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ae45cef7-572c-4820-9630-f781054f3086 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.250005 Apr 14 16:18:40.162231 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 530/1065] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:39 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:41.181696 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c18a50f5-d87b-4f26-b9c2-8458a397b556 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:41.182368 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c18a50f5-d87b-4f26-b9c2-8458a397b556 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:41.190329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c18a50f5-d87b-4f26-b9c2-8458a397b556 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:41.190833 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c18a50f5-d87b-4f26-b9c2-8458a397b556 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:41.191673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c18a50f5-d87b-4f26-b9c2-8458a397b556 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:41.192169 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c18a50f5-d87b-4f26-b9c2-8458a397b556 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:41.401064 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c18a50f5-d87b-4f26-b9c2-8458a397b556 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:41.410701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c18a50f5-d87b-4f26-b9c2-8458a397b556 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:41.412430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c18a50f5-d87b-4f26-b9c2-8458a397b556 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:41.413699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c18a50f5-d87b-4f26-b9c2-8458a397b556 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.236294 Apr 14 16:18:41.415076 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 536/1066] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:41 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:42.435309 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-06251a3c-40cd-4ee2-a0cc-1e9766f719e0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:42.436023 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-06251a3c-40cd-4ee2-a0cc-1e9766f719e0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:42.444254 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06251a3c-40cd-4ee2-a0cc-1e9766f719e0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:42.444760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06251a3c-40cd-4ee2-a0cc-1e9766f719e0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:42.445977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06251a3c-40cd-4ee2-a0cc-1e9766f719e0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:42.446612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06251a3c-40cd-4ee2-a0cc-1e9766f719e0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:42.657200 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-06251a3c-40cd-4ee2-a0cc-1e9766f719e0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:42.667315 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-06251a3c-40cd-4ee2-a0cc-1e9766f719e0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:42.669003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-06251a3c-40cd-4ee2-a0cc-1e9766f719e0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:42.670260 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-06251a3c-40cd-4ee2-a0cc-1e9766f719e0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.239335 Apr 14 16:18:42.670891 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 531/1067] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:42 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:43.690156 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b71b8679-4fbc-4b7e-9ad0-03186db76b72 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:43.690821 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b71b8679-4fbc-4b7e-9ad0-03186db76b72 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:43.699762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b71b8679-4fbc-4b7e-9ad0-03186db76b72 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:43.700267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b71b8679-4fbc-4b7e-9ad0-03186db76b72 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:43.701120 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b71b8679-4fbc-4b7e-9ad0-03186db76b72 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:43.701617 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b71b8679-4fbc-4b7e-9ad0-03186db76b72 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:43.910227 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b71b8679-4fbc-4b7e-9ad0-03186db76b72 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:43.920001 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b71b8679-4fbc-4b7e-9ad0-03186db76b72 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:43.921881 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b71b8679-4fbc-4b7e-9ad0-03186db76b72 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:43.923113 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b71b8679-4fbc-4b7e-9ad0-03186db76b72 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.237089 Apr 14 16:18:43.923734 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 537/1068] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:43 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:44.943191 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a3077e66-5103-4fe1-b319-d0fe6765107f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:44.943783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a3077e66-5103-4fe1-b319-d0fe6765107f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:44.952533 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a3077e66-5103-4fe1-b319-d0fe6765107f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:44.953062 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a3077e66-5103-4fe1-b319-d0fe6765107f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:44.953904 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a3077e66-5103-4fe1-b319-d0fe6765107f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:44.954398 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a3077e66-5103-4fe1-b319-d0fe6765107f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:45.166699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a3077e66-5103-4fe1-b319-d0fe6765107f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:45.176318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a3077e66-5103-4fe1-b319-d0fe6765107f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:45.178036 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a3077e66-5103-4fe1-b319-d0fe6765107f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:45.179286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a3077e66-5103-4fe1-b319-d0fe6765107f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.240251 Apr 14 16:18:45.180909 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 532/1069] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:44 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:46.200072 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0e00bbb8-af26-4007-8b80-4dad762c9536 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:46.200799 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0e00bbb8-af26-4007-8b80-4dad762c9536 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:46.211395 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0e00bbb8-af26-4007-8b80-4dad762c9536 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:46.212085 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0e00bbb8-af26-4007-8b80-4dad762c9536 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:46.212940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0e00bbb8-af26-4007-8b80-4dad762c9536 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:46.213463 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0e00bbb8-af26-4007-8b80-4dad762c9536 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:46.426311 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0e00bbb8-af26-4007-8b80-4dad762c9536 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:46.436710 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0e00bbb8-af26-4007-8b80-4dad762c9536 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:46.438421 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0e00bbb8-af26-4007-8b80-4dad762c9536 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:46.440045 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0e00bbb8-af26-4007-8b80-4dad762c9536 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.244070 Apr 14 16:18:46.440672 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 538/1070] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:46 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:47.461078 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f3a11da5-8dc7-43bf-897b-e66b8474e592 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:47.461739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f3a11da5-8dc7-43bf-897b-e66b8474e592 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:47.469653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f3a11da5-8dc7-43bf-897b-e66b8474e592 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:47.470163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f3a11da5-8dc7-43bf-897b-e66b8474e592 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:47.471001 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f3a11da5-8dc7-43bf-897b-e66b8474e592 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:47.471494 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f3a11da5-8dc7-43bf-897b-e66b8474e592 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:47.683924 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f3a11da5-8dc7-43bf-897b-e66b8474e592 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:47.695528 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f3a11da5-8dc7-43bf-897b-e66b8474e592 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:47.697299 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f3a11da5-8dc7-43bf-897b-e66b8474e592 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:47.698569 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f3a11da5-8dc7-43bf-897b-e66b8474e592 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.241621 Apr 14 16:18:47.703935 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 533/1071] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:47 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:48.718364 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f43d6e72-1834-4b60-a903-fc40d7f6e4e4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:48.719035 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f43d6e72-1834-4b60-a903-fc40d7f6e4e4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:48.727835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f43d6e72-1834-4b60-a903-fc40d7f6e4e4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:48.728347 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f43d6e72-1834-4b60-a903-fc40d7f6e4e4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:48.729231 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f43d6e72-1834-4b60-a903-fc40d7f6e4e4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:48.729730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f43d6e72-1834-4b60-a903-fc40d7f6e4e4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:48.942515 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f43d6e72-1834-4b60-a903-fc40d7f6e4e4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:48.953421 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f43d6e72-1834-4b60-a903-fc40d7f6e4e4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:48.955317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f43d6e72-1834-4b60-a903-fc40d7f6e4e4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:48.956608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f43d6e72-1834-4b60-a903-fc40d7f6e4e4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.242375 Apr 14 16:18:48.957263 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 539/1072] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:48 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:49.976149 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-87838eeb-2cf2-46d9-87ec-4ae1c832ebd0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:49.976866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-87838eeb-2cf2-46d9-87ec-4ae1c832ebd0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:49.984861 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-87838eeb-2cf2-46d9-87ec-4ae1c832ebd0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:49.985546 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-87838eeb-2cf2-46d9-87ec-4ae1c832ebd0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:49.986209 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-87838eeb-2cf2-46d9-87ec-4ae1c832ebd0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:49.986702 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-87838eeb-2cf2-46d9-87ec-4ae1c832ebd0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:50.210173 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-87838eeb-2cf2-46d9-87ec-4ae1c832ebd0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:50.221444 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-87838eeb-2cf2-46d9-87ec-4ae1c832ebd0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:50.223292 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-87838eeb-2cf2-46d9-87ec-4ae1c832ebd0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:50.224540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-87838eeb-2cf2-46d9-87ec-4ae1c832ebd0 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.252624 Apr 14 16:18:50.225226 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 534/1073] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:49 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:51.244439 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-026ac577-a9f4-4b71-9c2e-20fb01ccede2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:51.245993 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-026ac577-a9f4-4b71-9c2e-20fb01ccede2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:51.256508 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-026ac577-a9f4-4b71-9c2e-20fb01ccede2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:51.256940 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-026ac577-a9f4-4b71-9c2e-20fb01ccede2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:51.258372 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-026ac577-a9f4-4b71-9c2e-20fb01ccede2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:51.258869 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-026ac577-a9f4-4b71-9c2e-20fb01ccede2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:51.483705 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-026ac577-a9f4-4b71-9c2e-20fb01ccede2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:51.505341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-026ac577-a9f4-4b71-9c2e-20fb01ccede2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:51.511022 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-026ac577-a9f4-4b71-9c2e-20fb01ccede2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:51.513564 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-026ac577-a9f4-4b71-9c2e-20fb01ccede2 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.272671 Apr 14 16:18:51.514941 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 540/1074] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:51 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:52.536779 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e877c47c-90fd-47e2-a2d0-16bced0d8fd8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:52.537468 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e877c47c-90fd-47e2-a2d0-16bced0d8fd8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:52.546266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e877c47c-90fd-47e2-a2d0-16bced0d8fd8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:52.546777 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e877c47c-90fd-47e2-a2d0-16bced0d8fd8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:52.547628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e877c47c-90fd-47e2-a2d0-16bced0d8fd8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:52.548125 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e877c47c-90fd-47e2-a2d0-16bced0d8fd8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:52.748412 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e877c47c-90fd-47e2-a2d0-16bced0d8fd8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:52.758486 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e877c47c-90fd-47e2-a2d0-16bced0d8fd8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:52.760184 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e877c47c-90fd-47e2-a2d0-16bced0d8fd8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:52.761448 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e877c47c-90fd-47e2-a2d0-16bced0d8fd8 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.228744 Apr 14 16:18:52.762073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 535/1075] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:52 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:53.781574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4214cc2e-7cd0-42f6-8168-d4b962ccdc85 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:53.782659 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4214cc2e-7cd0-42f6-8168-d4b962ccdc85 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:53.791932 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4214cc2e-7cd0-42f6-8168-d4b962ccdc85 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:53.792480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4214cc2e-7cd0-42f6-8168-d4b962ccdc85 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:53.793405 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4214cc2e-7cd0-42f6-8168-d4b962ccdc85 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:53.793897 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4214cc2e-7cd0-42f6-8168-d4b962ccdc85 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:53.996457 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4214cc2e-7cd0-42f6-8168-d4b962ccdc85 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:54.006351 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4214cc2e-7cd0-42f6-8168-d4b962ccdc85 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:54.008116 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4214cc2e-7cd0-42f6-8168-d4b962ccdc85 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:54.009416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4214cc2e-7cd0-42f6-8168-d4b962ccdc85 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.231890 Apr 14 16:18:54.010051 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 541/1076] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:53 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:55.027978 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8ab0c911-dc20-493b-96b8-f07de58fadda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:55.028688 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8ab0c911-dc20-493b-96b8-f07de58fadda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:55.037215 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8ab0c911-dc20-493b-96b8-f07de58fadda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:55.037726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8ab0c911-dc20-493b-96b8-f07de58fadda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:55.039062 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8ab0c911-dc20-493b-96b8-f07de58fadda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:55.039555 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8ab0c911-dc20-493b-96b8-f07de58fadda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:55.270025 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8ab0c911-dc20-493b-96b8-f07de58fadda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:55.280284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8ab0c911-dc20-493b-96b8-f07de58fadda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:55.282250 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8ab0c911-dc20-493b-96b8-f07de58fadda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:55.283466 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8ab0c911-dc20-493b-96b8-f07de58fadda tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.259565 Apr 14 16:18:55.284091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 536/1077] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:55 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:56.227915 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-dfa1adaf-243b-4e11-8b3f-937a38a81dad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:56.229079 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-dfa1adaf-243b-4e11-8b3f-937a38a81dad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:56.237811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dfa1adaf-243b-4e11-8b3f-937a38a81dad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:56.238462 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dfa1adaf-243b-4e11-8b3f-937a38a81dad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:56.239704 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dfa1adaf-243b-4e11-8b3f-937a38a81dad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:56.240207 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dfa1adaf-243b-4e11-8b3f-937a38a81dad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:56.303645 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3ccd4c9a-77f8-4a1f-a0e2-f9b5dee8e419 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:56.304851 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3ccd4c9a-77f8-4a1f-a0e2-f9b5dee8e419 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:56.319164 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-dfa1adaf-243b-4e11-8b3f-937a38a81dad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.095224 Apr 14 16:18:56.319401 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3ccd4c9a-77f8-4a1f-a0e2-f9b5dee8e419 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:56.319667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3ccd4c9a-77f8-4a1f-a0e2-f9b5dee8e419 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:56.319867 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 542/1078] 10.222.0.60 () {58 vars in 1292 bytes} [Wed Apr 14 16:18:56 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments => generated 371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:56.326377 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3ccd4c9a-77f8-4a1f-a0e2-f9b5dee8e419 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:56.326888 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3ccd4c9a-77f8-4a1f-a0e2-f9b5dee8e419 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:56.547625 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3ccd4c9a-77f8-4a1f-a0e2-f9b5dee8e419 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:56.559449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3ccd4c9a-77f8-4a1f-a0e2-f9b5dee8e419 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:56.561338 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3ccd4c9a-77f8-4a1f-a0e2-f9b5dee8e419 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:56.562581 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3ccd4c9a-77f8-4a1f-a0e2-f9b5dee8e419 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.263032 Apr 14 16:18:56.569745 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 537/1079] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:56 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:56.582438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-27a9cc42-f99f-40fd-934d-ba6f4f7948aa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:56.583053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-27a9cc42-f99f-40fd-934d-ba6f4f7948aa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:56.591647 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-27a9cc42-f99f-40fd-934d-ba6f4f7948aa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:56.592159 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-27a9cc42-f99f-40fd-934d-ba6f4f7948aa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:56.593006 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-27a9cc42-f99f-40fd-934d-ba6f4f7948aa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:56.593520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-27a9cc42-f99f-40fd-934d-ba6f4f7948aa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:56.653783 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-29b90843-99d6-4e11-9cfe-4f79a59211e4 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:56.654329 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-29b90843-99d6-4e11-9cfe-4f79a59211e4 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:56.662752 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29b90843-99d6-4e11-9cfe-4f79a59211e4 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:56.663258 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29b90843-99d6-4e11-9cfe-4f79a59211e4 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:56.663419 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-27a9cc42-f99f-40fd-934d-ba6f4f7948aa tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments/d91e9244-b4f9-48bf-84a7-6310d1cb1293" status: 200 len: 194 microversion: 2.1 time: 0.085068 Apr 14 16:18:56.664798 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29b90843-99d6-4e11-9cfe-4f79a59211e4 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:56.665313 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-29b90843-99d6-4e11-9cfe-4f79a59211e4 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:56.668754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 543/1080] 10.222.0.60 () {58 vars in 1403 bytes} [Wed Apr 14 16:18:56 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments/d91e9244-b4f9-48bf-84a7-6310d1cb1293 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:18:56.676123 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ec10096d-692a-4aa2-b9cd-718403f1122c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:56.676663 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ec10096d-692a-4aa2-b9cd-718403f1122c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:56.685170 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ec10096d-692a-4aa2-b9cd-718403f1122c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:56.685675 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ec10096d-692a-4aa2-b9cd-718403f1122c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:56.686507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ec10096d-692a-4aa2-b9cd-718403f1122c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:56.686995 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ec10096d-692a-4aa2-b9cd-718403f1122c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:56.732273 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-29b90843-99d6-4e11-9cfe-4f79a59211e4 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Going to try to terminate instance {{(pid=99334) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:18:56.851070 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-29b90843-99d6-4e11-9cfe-4f79a59211e4 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 204 len: 0 microversion: 2.1 time: 0.200881 Apr 14 16:18:56.852195 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 538/1081] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:18:56 2021] DELETE /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:18:56.861885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-aecf120f-e355-4892-8ad8-27779c4a4d1d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:56.862668 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-aecf120f-e355-4892-8ad8-27779c4a4d1d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:56.870576 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aecf120f-e355-4892-8ad8-27779c4a4d1d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:56.871078 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aecf120f-e355-4892-8ad8-27779c4a4d1d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:56.871909 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aecf120f-e355-4892-8ad8-27779c4a4d1d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:56.872395 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-aecf120f-e355-4892-8ad8-27779c4a4d1d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:56.878199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-ec10096d-692a-4aa2-b9cd-718403f1122c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lazy-loading 'services' on Instance uuid 8aec1638-2b51-4bc7-a664-e2d1b227228f {{(pid=99335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:18:57.026245 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ec10096d-692a-4aa2-b9cd-718403f1122c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments/d91e9244-b4f9-48bf-84a7-6310d1cb1293" status: 202 len: 0 microversion: 2.1 time: 0.353895 Apr 14 16:18:57.031035 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 544/1082] 10.222.0.60 () {58 vars in 1406 bytes} [Wed Apr 14 16:18:56 2021] DELETE /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments/d91e9244-b4f9-48bf-84a7-6310d1cb1293 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:18:57.104931 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-aecf120f-e355-4892-8ad8-27779c4a4d1d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:57.114821 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-aecf120f-e355-4892-8ad8-27779c4a4d1d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1512 microversion: 2.1 time: 0.257404 Apr 14 16:18:57.115823 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 539/1083] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:56 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:18:57.584354 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-79566fe8-add5-4323-9fc0-3ceea319e2fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:57.585144 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-79566fe8-add5-4323-9fc0-3ceea319e2fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:57.593322 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79566fe8-add5-4323-9fc0-3ceea319e2fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:57.593828 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79566fe8-add5-4323-9fc0-3ceea319e2fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:57.594654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79566fe8-add5-4323-9fc0-3ceea319e2fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:57.595145 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-79566fe8-add5-4323-9fc0-3ceea319e2fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:57.790257 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-79566fe8-add5-4323-9fc0-3ceea319e2fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:57.799719 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-79566fe8-add5-4323-9fc0-3ceea319e2fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:57.801426 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-79566fe8-add5-4323-9fc0-3ceea319e2fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:57.802650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-79566fe8-add5-4323-9fc0-3ceea319e2fd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.223021 Apr 14 16:18:57.803267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 545/1084] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:57 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:58.134544 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-00504952-96b4-4b18-973f-250c2fd548bb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:58.135214 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-00504952-96b4-4b18-973f-250c2fd548bb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:58.143687 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00504952-96b4-4b18-973f-250c2fd548bb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:58.144199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00504952-96b4-4b18-973f-250c2fd548bb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:58.145066 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00504952-96b4-4b18-973f-250c2fd548bb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:58.145546 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-00504952-96b4-4b18-973f-250c2fd548bb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:58.349439 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-00504952-96b4-4b18-973f-250c2fd548bb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:58.359442 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-00504952-96b4-4b18-973f-250c2fd548bb tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1512 microversion: 2.1 time: 0.229347 Apr 14 16:18:58.360091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 540/1085] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:58 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:58.822907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2a301170-ef40-447c-bd45-e5c4331c4294 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:58.823572 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2a301170-ef40-447c-bd45-e5c4331c4294 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:58.832099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2a301170-ef40-447c-bd45-e5c4331c4294 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:58.832612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2a301170-ef40-447c-bd45-e5c4331c4294 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:58.833510 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2a301170-ef40-447c-bd45-e5c4331c4294 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:58.834008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2a301170-ef40-447c-bd45-e5c4331c4294 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:59.034609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2a301170-ef40-447c-bd45-e5c4331c4294 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:59.044485 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2a301170-ef40-447c-bd45-e5c4331c4294 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:59.046190 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2a301170-ef40-447c-bd45-e5c4331c4294 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:59.047407 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2a301170-ef40-447c-bd45-e5c4331c4294 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.228737 Apr 14 16:18:59.048033 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 546/1086] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:18:58 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:18:59.360566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2721f80b-31e3-4c5d-8c99-398082462e48 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:59.361193 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2721f80b-31e3-4c5d-8c99-398082462e48 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:59.369700 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2721f80b-31e3-4c5d-8c99-398082462e48 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:59.370199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2721f80b-31e3-4c5d-8c99-398082462e48 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:59.371034 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2721f80b-31e3-4c5d-8c99-398082462e48 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:59.372245 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2721f80b-31e3-4c5d-8c99-398082462e48 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:59.377842 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bd1a499a-ec15-43f9-8fad-77beae4d2b7d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:59.378507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bd1a499a-ec15-43f9-8fad-77beae4d2b7d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:59.387168 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd1a499a-ec15-43f9-8fad-77beae4d2b7d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:59.387679 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd1a499a-ec15-43f9-8fad-77beae4d2b7d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:59.388523 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd1a499a-ec15-43f9-8fad-77beae4d2b7d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:59.389013 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bd1a499a-ec15-43f9-8fad-77beae4d2b7d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:59.442676 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2721f80b-31e3-4c5d-8c99-398082462e48 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments/536ebb4f-e4db-4786-9af3-11e7c7f6ddf2" status: 200 len: 194 microversion: 2.1 time: 0.086143 Apr 14 16:18:59.443340 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 541/1087] 10.222.0.60 () {58 vars in 1403 bytes} [Wed Apr 14 16:18:59 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments/536ebb4f-e4db-4786-9af3-11e7c7f6ddf2 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:59.453727 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d00e2cf0-95c5-49d9-9c95-23c41900800c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:18:59.454270 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d00e2cf0-95c5-49d9-9c95-23c41900800c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:18:59.461964 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d00e2cf0-95c5-49d9-9c95-23c41900800c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:59.462467 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d00e2cf0-95c5-49d9-9c95-23c41900800c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:59.463301 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d00e2cf0-95c5-49d9-9c95-23c41900800c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:18:59.463788 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d00e2cf0-95c5-49d9-9c95-23c41900800c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:18:59.585900 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bd1a499a-ec15-43f9-8fad-77beae4d2b7d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:18:59.594899 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bd1a499a-ec15-43f9-8fad-77beae4d2b7d tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1512 microversion: 2.1 time: 0.220855 Apr 14 16:18:59.595603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 547/1088] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:18:59 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:59.642868 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-d00e2cf0-95c5-49d9-9c95-23c41900800c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lazy-loading 'services' on Instance uuid 8aec1638-2b51-4bc7-a664-e2d1b227228f {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:18:59.787757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d00e2cf0-95c5-49d9-9c95-23c41900800c tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments/536ebb4f-e4db-4786-9af3-11e7c7f6ddf2" status: 202 len: 0 microversion: 2.1 time: 0.337503 Apr 14 16:18:59.789245 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 542/1089] 10.222.0.60 () {58 vars in 1406 bytes} [Wed Apr 14 16:18:59 2021] DELETE /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f/os-volume_attachments/536ebb4f-e4db-4786-9af3-11e7c7f6ddf2 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 16:19:00.066866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b80737e8-c99a-4d85-890e-fb0dfefcae5d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:00.067623 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b80737e8-c99a-4d85-890e-fb0dfefcae5d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:00.075640 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b80737e8-c99a-4d85-890e-fb0dfefcae5d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:00.076142 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b80737e8-c99a-4d85-890e-fb0dfefcae5d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:00.076972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b80737e8-c99a-4d85-890e-fb0dfefcae5d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:00.077492 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b80737e8-c99a-4d85-890e-fb0dfefcae5d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:00.290226 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b80737e8-c99a-4d85-890e-fb0dfefcae5d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:00.300433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b80737e8-c99a-4d85-890e-fb0dfefcae5d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:00.302610 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b80737e8-c99a-4d85-890e-fb0dfefcae5d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:00.303418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b80737e8-c99a-4d85-890e-fb0dfefcae5d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.240613 Apr 14 16:19:00.304076 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 548/1090] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:19:00 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:19:00.484661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-1da55e6f-f76b-4b70-b474-da5228717746 req-d0d48d4c-0880-4bf6-a0b7-b7b1b43759c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e45e06-d4ec-48d7-8576-da008e2a2bbe", "name": "network-vif-plugged", "status": "completed", "tag": "86985f08-70cd-4417-8f18-ff0ada9a82ff"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:19:00.486596 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:19:00.486596 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:19:00.498339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-1da55e6f-f76b-4b70-b474-da5228717746 req-d0d48d4c-0880-4bf6-a0b7-b7b1b43759c7 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:00.498339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-1da55e6f-f76b-4b70-b474-da5228717746 req-d0d48d4c-0880-4bf6-a0b7-b7b1b43759c7 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:00.517897 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-1da55e6f-f76b-4b70-b474-da5228717746 req-d0d48d4c-0880-4bf6-a0b7-b7b1b43759c7 service nova] Creating event network-vif-plugged:86985f08-70cd-4417-8f18-ff0ada9a82ff for instance 67e45e06-d4ec-48d7-8576-da008e2a2bbe on hv-cinder-78626 Apr 14 16:19:00.524714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-1da55e6f-f76b-4b70-b474-da5228717746 req-d0d48d4c-0880-4bf6-a0b7-b7b1b43759c7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043298 Apr 14 16:19:00.525452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 543/1091] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:19:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:19:00.614278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1a47f8ff-3570-42c1-bc69-ad0ec184aeb2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:00.614949 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1a47f8ff-3570-42c1-bc69-ad0ec184aeb2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:00.623929 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1a47f8ff-3570-42c1-bc69-ad0ec184aeb2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:00.624468 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1a47f8ff-3570-42c1-bc69-ad0ec184aeb2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:00.625341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1a47f8ff-3570-42c1-bc69-ad0ec184aeb2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:00.625996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1a47f8ff-3570-42c1-bc69-ad0ec184aeb2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:00.808903 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1a47f8ff-3570-42c1-bc69-ad0ec184aeb2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e44d70d92dd4dc69199692b1caca12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73844004f69a481dba93081e4d2b284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:00.818866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1a47f8ff-3570-42c1-bc69-ad0ec184aeb2 tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 200 len: 1470 microversion: 2.1 time: 0.208925 Apr 14 16:19:00.819794 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 549/1092] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:19:00 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 1470 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:19:00.918710 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-e68fe988-fadb-491c-a444-d0e1ea55ac1b req-380908bf-bf36-42bb-b32a-c87c35c6b586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ebf4fdb-09d1-44fa-b9ac-142842d75209", "name": "network-vif-deleted", "tag": "b5f19e49-684a-45d4-875e-1398ffcf49b7"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:19:00.920683 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:19:00.920683 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:19:00.931117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-e68fe988-fadb-491c-a444-d0e1ea55ac1b req-380908bf-bf36-42bb-b32a-c87c35c6b586 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:00.931646 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-e68fe988-fadb-491c-a444-d0e1ea55ac1b req-380908bf-bf36-42bb-b32a-c87c35c6b586 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:00.951001 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-e68fe988-fadb-491c-a444-d0e1ea55ac1b req-380908bf-bf36-42bb-b32a-c87c35c6b586 service nova] Creating event network-vif-deleted:b5f19e49-684a-45d4-875e-1398ffcf49b7 for instance 1ebf4fdb-09d1-44fa-b9ac-142842d75209 on hv-cinder-78626 Apr 14 16:19:00.959151 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-e68fe988-fadb-491c-a444-d0e1ea55ac1b req-380908bf-bf36-42bb-b32a-c87c35c6b586 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045822 Apr 14 16:19:00.959845 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 544/1093] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:19:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:19:01.323017 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6f30021e-6aad-4efb-8c93-ff5df3d4fb24 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:01.323685 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6f30021e-6aad-4efb-8c93-ff5df3d4fb24 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:01.331541 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f30021e-6aad-4efb-8c93-ff5df3d4fb24 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:01.332047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f30021e-6aad-4efb-8c93-ff5df3d4fb24 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:01.332881 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f30021e-6aad-4efb-8c93-ff5df3d4fb24 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:01.333397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f30021e-6aad-4efb-8c93-ff5df3d4fb24 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:01.410176 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-05c1e1a2-9b17-4ea3-8b61-7de00a00a24b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:01.410885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-05c1e1a2-9b17-4ea3-8b61-7de00a00a24b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:01.419941 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-05c1e1a2-9b17-4ea3-8b61-7de00a00a24b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:01.420455 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-05c1e1a2-9b17-4ea3-8b61-7de00a00a24b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:01.421348 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-05c1e1a2-9b17-4ea3-8b61-7de00a00a24b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:01.421847 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-05c1e1a2-9b17-4ea3-8b61-7de00a00a24b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:01.489344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-05c1e1a2-9b17-4ea3-8b61-7de00a00a24b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Going to try to terminate instance {{(pid=99334) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:19:01.530766 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6f30021e-6aad-4efb-8c93-ff5df3d4fb24 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:01.542435 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6f30021e-6aad-4efb-8c93-ff5df3d4fb24 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:01.544110 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6f30021e-6aad-4efb-8c93-ff5df3d4fb24 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:01.545357 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6f30021e-6aad-4efb-8c93-ff5df3d4fb24 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.226408 Apr 14 16:19:01.545971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 550/1094] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:19:01 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:19:01.615083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-05c1e1a2-9b17-4ea3-8b61-7de00a00a24b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 204 len: 0 microversion: 2.1 time: 0.209297 Apr 14 16:19:01.615660 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 545/1095] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:19:01 2021] DELETE /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 14 16:19:01.626090 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2a01d972-830e-43ab-b110-1ae312a99954 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:01.626759 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2a01d972-830e-43ab-b110-1ae312a99954 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:01.634839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2a01d972-830e-43ab-b110-1ae312a99954 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:01.635342 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2a01d972-830e-43ab-b110-1ae312a99954 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:01.636171 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2a01d972-830e-43ab-b110-1ae312a99954 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:01.636658 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2a01d972-830e-43ab-b110-1ae312a99954 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:01.836027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2a01d972-830e-43ab-b110-1ae312a99954 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:01.839480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-318b20e0-59d4-4b9f-9e71-5200f4df519a tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:01.840247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-318b20e0-59d4-4b9f-9e71-5200f4df519a tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] [instance: 1ebf4fdb-09d1-44fa-b9ac-142842d75209] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:01.845153 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2a01d972-830e-43ab-b110-1ae312a99954 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1674 microversion: 2.1 time: 0.223927 Apr 14 16:19:01.845789 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 551/1096] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:19:01 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1674 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:19:01.848162 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-318b20e0-59d4-4b9f-9e71-5200f4df519a tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:01.848700 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-318b20e0-59d4-4b9f-9e71-5200f4df519a tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:01.849552 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-318b20e0-59d4-4b9f-9e71-5200f4df519a tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:01.850039 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-318b20e0-59d4-4b9f-9e71-5200f4df519a tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:01.903654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-318b20e0-59d4-4b9f-9e71-5200f4df519a tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] HTTP exception thrown: Instance 1ebf4fdb-09d1-44fa-b9ac-142842d75209 could not be found. Apr 14 16:19:01.904241 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-318b20e0-59d4-4b9f-9e71-5200f4df519a tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] Returning 404 to user: Instance 1ebf4fdb-09d1-44fa-b9ac-142842d75209 could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:19:01.905164 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-318b20e0-59d4-4b9f-9e71-5200f4df519a tempest-VolumesSnapshotTestJSON-1719232058 tempest-VolumesSnapshotTestJSON-1719232058-project] 10.222.0.60 "GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209" status: 404 len: 111 microversion: 2.1 time: 0.070995 Apr 14 16:19:01.905764 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 546/1097] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:19:01 2021] GET /compute/v2.1/servers/1ebf4fdb-09d1-44fa-b9ac-142842d75209 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:19:02.565811 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0d82e350-0066-43b0-83a3-a0fd985132b4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:02.566242 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0d82e350-0066-43b0-83a3-a0fd985132b4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:02.574619 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d82e350-0066-43b0-83a3-a0fd985132b4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:02.575127 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d82e350-0066-43b0-83a3-a0fd985132b4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:02.575969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d82e350-0066-43b0-83a3-a0fd985132b4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:02.576463 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0d82e350-0066-43b0-83a3-a0fd985132b4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:02.864359 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6ab216f9-74df-4a00-9b1b-81e38937d860 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:02.865064 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6ab216f9-74df-4a00-9b1b-81e38937d860 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:02.873330 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ab216f9-74df-4a00-9b1b-81e38937d860 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:02.873835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ab216f9-74df-4a00-9b1b-81e38937d860 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:02.874703 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ab216f9-74df-4a00-9b1b-81e38937d860 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:02.875202 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6ab216f9-74df-4a00-9b1b-81e38937d860 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:02.917991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0d82e350-0066-43b0-83a3-a0fd985132b4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:02.927302 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0d82e350-0066-43b0-83a3-a0fd985132b4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:02.928997 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0d82e350-0066-43b0-83a3-a0fd985132b4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:02.930238 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0d82e350-0066-43b0-83a3-a0fd985132b4 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1730 microversion: 2.20 time: 0.369034 Apr 14 16:19:02.930852 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 552/1098] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:19:02 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1730 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:19:03.077120 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6ab216f9-74df-4a00-9b1b-81e38937d860 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:03.086572 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6ab216f9-74df-4a00-9b1b-81e38937d860 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1674 microversion: 2.1 time: 0.226627 Apr 14 16:19:03.087257 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 547/1099] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:19:02 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1674 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:19:03.949445 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f1c88978-cbbb-47c8-a3e4-dad4e1110c88 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:03.950091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f1c88978-cbbb-47c8-a3e4-dad4e1110c88 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:03.957909 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1c88978-cbbb-47c8-a3e4-dad4e1110c88 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:03.958416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1c88978-cbbb-47c8-a3e4-dad4e1110c88 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:03.959239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1c88978-cbbb-47c8-a3e4-dad4e1110c88 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:03.959725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1c88978-cbbb-47c8-a3e4-dad4e1110c88 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:04.106672 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6b2d35cd-7e0b-42c0-8e83-1106613748b7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:04.107748 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6b2d35cd-7e0b-42c0-8e83-1106613748b7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:04.118058 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b2d35cd-7e0b-42c0-8e83-1106613748b7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:04.118995 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b2d35cd-7e0b-42c0-8e83-1106613748b7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:04.120063 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b2d35cd-7e0b-42c0-8e83-1106613748b7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:04.120770 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6b2d35cd-7e0b-42c0-8e83-1106613748b7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:04.165259 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f1c88978-cbbb-47c8-a3e4-dad4e1110c88 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:04.175519 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f1c88978-cbbb-47c8-a3e4-dad4e1110c88 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:04.177446 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f1c88978-cbbb-47c8-a3e4-dad4e1110c88 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:04.178738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f1c88978-cbbb-47c8-a3e4-dad4e1110c88 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1717 microversion: 2.20 time: 0.233493 Apr 14 16:19:04.180109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 553/1100] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:19:03 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1717 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:19:04.341541 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6b2d35cd-7e0b-42c0-8e83-1106613748b7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:04.350725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6b2d35cd-7e0b-42c0-8e83-1106613748b7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1674 microversion: 2.1 time: 0.249434 Apr 14 16:19:04.351547 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 548/1101] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:19:04 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1674 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:19:05.370047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b6429cbc-9750-4945-9466-ca41b126af2a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:05.370706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b6429cbc-9750-4945-9466-ca41b126af2a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:05.378611 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b6429cbc-9750-4945-9466-ca41b126af2a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:05.379124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b6429cbc-9750-4945-9466-ca41b126af2a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:05.379948 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b6429cbc-9750-4945-9466-ca41b126af2a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:05.380433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b6429cbc-9750-4945-9466-ca41b126af2a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:05.575231 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b6429cbc-9750-4945-9466-ca41b126af2a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:05.584037 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b6429cbc-9750-4945-9466-ca41b126af2a tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1674 microversion: 2.1 time: 0.218143 Apr 14 16:19:05.584656 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 554/1102] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:19:05 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1674 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:19:06.604810 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-88fe4a8d-efa6-4d68-a86a-8d41e79b80d2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:06.605502 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-88fe4a8d-efa6-4d68-a86a-8d41e79b80d2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:06.613491 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-88fe4a8d-efa6-4d68-a86a-8d41e79b80d2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:06.613993 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-88fe4a8d-efa6-4d68-a86a-8d41e79b80d2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:06.614859 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-88fe4a8d-efa6-4d68-a86a-8d41e79b80d2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:06.615346 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-88fe4a8d-efa6-4d68-a86a-8d41e79b80d2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:06.816251 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-88fe4a8d-efa6-4d68-a86a-8d41e79b80d2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:06.825617 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-88fe4a8d-efa6-4d68-a86a-8d41e79b80d2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1674 microversion: 2.1 time: 0.225411 Apr 14 16:19:06.826247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 549/1103] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:19:06 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1674 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:19:07.844320 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0bc53cbe-f5e3-4cbc-b9ed-91d184d89c2d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:07.845074 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0bc53cbe-f5e3-4cbc-b9ed-91d184d89c2d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:07.854428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0bc53cbe-f5e3-4cbc-b9ed-91d184d89c2d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:07.854942 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0bc53cbe-f5e3-4cbc-b9ed-91d184d89c2d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:07.855793 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0bc53cbe-f5e3-4cbc-b9ed-91d184d89c2d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:07.856285 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0bc53cbe-f5e3-4cbc-b9ed-91d184d89c2d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:08.072356 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0bc53cbe-f5e3-4cbc-b9ed-91d184d89c2d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:08.083449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0bc53cbe-f5e3-4cbc-b9ed-91d184d89c2d tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1674 microversion: 2.1 time: 0.243220 Apr 14 16:19:08.084425 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 555/1104] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:19:07 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1674 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:19:09.102892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8df0972d-e3e2-469f-9ac4-38d6467a5de0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:09.103592 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8df0972d-e3e2-469f-9ac4-38d6467a5de0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:09.111959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8df0972d-e3e2-469f-9ac4-38d6467a5de0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:09.112689 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8df0972d-e3e2-469f-9ac4-38d6467a5de0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:09.113724 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8df0972d-e3e2-469f-9ac4-38d6467a5de0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:09.114394 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8df0972d-e3e2-469f-9ac4-38d6467a5de0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:09.329822 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8df0972d-e3e2-469f-9ac4-38d6467a5de0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041bede4dd8e421c939c6fd868ac654e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c87bdb5354dc39f728c1bc6dfd17e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:09.339730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8df0972d-e3e2-469f-9ac4-38d6467a5de0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 200 len: 1606 microversion: 2.1 time: 0.241125 Apr 14 16:19:09.340363 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 550/1105] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:19:09 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 1606 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:19:09.357638 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-67f40fd6-021f-4d0e-8e35-65ef22601836 req-3c4bc3d2-2912-43db-b6d7-ebf16ab0c8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aec1638-2b51-4bc7-a664-e2d1b227228f", "name": "network-vif-deleted", "tag": "f1caa616-44ca-499b-9670-8b92cff097ae"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:19:09.359456 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:19:09.359456 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:19:09.369627 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-67f40fd6-021f-4d0e-8e35-65ef22601836 req-3c4bc3d2-2912-43db-b6d7-ebf16ab0c8af service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:09.370127 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-67f40fd6-021f-4d0e-8e35-65ef22601836 req-3c4bc3d2-2912-43db-b6d7-ebf16ab0c8af service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:09.389416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-67f40fd6-021f-4d0e-8e35-65ef22601836 req-3c4bc3d2-2912-43db-b6d7-ebf16ab0c8af service nova] Creating event network-vif-deleted:f1caa616-44ca-499b-9670-8b92cff097ae for instance 8aec1638-2b51-4bc7-a664-e2d1b227228f on hv-cinder-78626 Apr 14 16:19:09.394815 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-67f40fd6-021f-4d0e-8e35-65ef22601836 req-3c4bc3d2-2912-43db-b6d7-ebf16ab0c8af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041593 Apr 14 16:19:09.395477 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 556/1106] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:19:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:19:10.363091 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-85fb5358-dbe2-470e-8c4d-f45eefa6fbf2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:10.363865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-85fb5358-dbe2-470e-8c4d-f45eefa6fbf2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:10.372340 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85fb5358-dbe2-470e-8c4d-f45eefa6fbf2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:10.372955 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85fb5358-dbe2-470e-8c4d-f45eefa6fbf2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:10.374232 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85fb5358-dbe2-470e-8c4d-f45eefa6fbf2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:10.374669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-85fb5358-dbe2-470e-8c4d-f45eefa6fbf2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:10.431335 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-85fb5358-dbe2-470e-8c4d-f45eefa6fbf2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] HTTP exception thrown: Instance 8aec1638-2b51-4bc7-a664-e2d1b227228f could not be found. Apr 14 16:19:10.432017 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-85fb5358-dbe2-470e-8c4d-f45eefa6fbf2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Returning 404 to user: Instance 8aec1638-2b51-4bc7-a664-e2d1b227228f could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:19:10.432939 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-85fb5358-dbe2-470e-8c4d-f45eefa6fbf2 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 404 len: 111 microversion: 2.1 time: 0.078125 Apr 14 16:19:10.433654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 551/1107] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:19:10 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:19:10.443861 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-441b73c3-60e7-4a7e-a0fd-342f1d3035f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '.version_select at 0x7ff58d6c0c80>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:10.461738 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-441b73c3-60e7-4a7e-a0fd-342f1d3035f0 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137835968" status: 202 len: 0 microversion: 2.1 time: 0.022905 Apr 14 16:19:10.462410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 557/1108] 10.222.0.60 () {58 vars in 1211 bytes} [Wed Apr 14 16:19:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137835968 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:19:17.299313 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ea1f3137-454c-498b-924e-ba24086753ad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:17.300084 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ea1f3137-454c-498b-924e-ba24086753ad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:17.315949 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ea1f3137-454c-498b-924e-ba24086753ad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:17.316462 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ea1f3137-454c-498b-924e-ba24086753ad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:17.317351 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ea1f3137-454c-498b-924e-ba24086753ad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:17.317851 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ea1f3137-454c-498b-924e-ba24086753ad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:17.376721 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-ea1f3137-454c-498b-924e-ba24086753ad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] HTTP exception thrown: Instance 8aec1638-2b51-4bc7-a664-e2d1b227228f could not be found. Apr 14 16:19:17.377426 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ea1f3137-454c-498b-924e-ba24086753ad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Returning 404 to user: Instance 8aec1638-2b51-4bc7-a664-e2d1b227228f could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:19:17.378350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ea1f3137-454c-498b-924e-ba24086753ad tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 404 len: 111 microversion: 2.1 time: 0.083275 Apr 14 16:19:17.378979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 552/1109] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:19:17 2021] DELETE /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:19:17.388165 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c09100f6-b97b-4a63-b43c-08b0cb9863e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:17.388972 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c09100f6-b97b-4a63-b43c-08b0cb9863e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 8aec1638-2b51-4bc7-a664-e2d1b227228f] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:17.397614 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c09100f6-b97b-4a63-b43c-08b0cb9863e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:17.398132 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c09100f6-b97b-4a63-b43c-08b0cb9863e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:17.399178 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c09100f6-b97b-4a63-b43c-08b0cb9863e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:17.399684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c09100f6-b97b-4a63-b43c-08b0cb9863e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:17.453934 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-c09100f6-b97b-4a63-b43c-08b0cb9863e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] HTTP exception thrown: Instance 8aec1638-2b51-4bc7-a664-e2d1b227228f could not be found. Apr 14 16:19:17.454614 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c09100f6-b97b-4a63-b43c-08b0cb9863e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Returning 404 to user: Instance 8aec1638-2b51-4bc7-a664-e2d1b227228f could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:19:17.455661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c09100f6-b97b-4a63-b43c-08b0cb9863e8 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f" status: 404 len: 111 microversion: 2.1 time: 0.071490 Apr 14 16:19:17.456297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 558/1110] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:19:17 2021] GET /compute/v2.1/servers/8aec1638-2b51-4bc7-a664-e2d1b227228f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:19:18.726510 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4daac4fd-03e6-4d4f-99a1-308ff8a3270b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:18.727030 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4daac4fd-03e6-4d4f-99a1-308ff8a3270b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:18.734821 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4daac4fd-03e6-4d4f-99a1-308ff8a3270b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:18.735331 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4daac4fd-03e6-4d4f-99a1-308ff8a3270b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:18.736171 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4daac4fd-03e6-4d4f-99a1-308ff8a3270b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:18.736668 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4daac4fd-03e6-4d4f-99a1-308ff8a3270b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:18.790968 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-4daac4fd-03e6-4d4f-99a1-308ff8a3270b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] HTTP exception thrown: Instance 0dd8ae4b-9ee1-4ba9-830e-d1e721901938 could not be found. Apr 14 16:19:18.791652 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4daac4fd-03e6-4d4f-99a1-308ff8a3270b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Returning 404 to user: Instance 0dd8ae4b-9ee1-4ba9-830e-d1e721901938 could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:19:18.792574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4daac4fd-03e6-4d4f-99a1-308ff8a3270b tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 404 len: 111 microversion: 2.1 time: 0.070178 Apr 14 16:19:18.793244 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 553/1111] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:19:18 2021] DELETE /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:19:18.801762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-22f3cc2a-5ba9-4a0e-a095-1242c171b9f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:18.802568 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-22f3cc2a-5ba9-4a0e-a095-1242c171b9f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] [instance: 0dd8ae4b-9ee1-4ba9-830e-d1e721901938] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:18.811376 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-22f3cc2a-5ba9-4a0e-a095-1242c171b9f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:18.811959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-22f3cc2a-5ba9-4a0e-a095-1242c171b9f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:18.812877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-22f3cc2a-5ba9-4a0e-a095-1242c171b9f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:18.813632 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-22f3cc2a-5ba9-4a0e-a095-1242c171b9f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:18.867690 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-22f3cc2a-5ba9-4a0e-a095-1242c171b9f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] HTTP exception thrown: Instance 0dd8ae4b-9ee1-4ba9-830e-d1e721901938 could not be found. Apr 14 16:19:18.868368 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-22f3cc2a-5ba9-4a0e-a095-1242c171b9f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] Returning 404 to user: Instance 0dd8ae4b-9ee1-4ba9-830e-d1e721901938 could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:19:18.869335 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-22f3cc2a-5ba9-4a0e-a095-1242c171b9f7 tempest-AttachVolumeTestJSON-282805742 tempest-AttachVolumeTestJSON-282805742-project] 10.222.0.60 "GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938" status: 404 len: 111 microversion: 2.1 time: 0.071604 Apr 14 16:19:18.869959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 559/1112] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:19:18 2021] GET /compute/v2.1/servers/0dd8ae4b-9ee1-4ba9-830e-d1e721901938 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:19:27.643396 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-036faef8-f319-468d-b81e-f94b8f934d73 tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] Action: 'create', calling method: .version_select at 0x7ff58e938730>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-121920447", "metadata": {"Type": "work"}}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:19:28.084725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-036faef8-f319-468d-b81e-f94b8f934d73 tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.570464 Apr 14 16:19:28.085652 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 554/1113] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Apr 14 16:19:27 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 572 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 14 16:19:28.097677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1816dc77-52df-44d9-83ad-c70031c18337 tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] Calling method '.version_select at 0x7ff58ca32378>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:28.215973 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1816dc77-52df-44d9-83ad-c70031c18337 tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3b9929d9-9e28-440a-b4e8-e16b6681f2db" status: 200 len: 352 microversion: 2.1 time: 0.122308 Apr 14 16:19:28.217406 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 560/1114] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Apr 14 16:19:28 2021] GET /compute/v2.1/os-volumes/3b9929d9-9e28-440a-b4e8-e16b6681f2db => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:19:29.231085 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bfceb165-94fd-4b04-a69d-47ebf114b230 tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] Calling method '.version_select at 0x7ff58e0ace18>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:29.332458 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bfceb165-94fd-4b04-a69d-47ebf114b230 tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3b9929d9-9e28-440a-b4e8-e16b6681f2db" status: 200 len: 353 microversion: 2.1 time: 0.105312 Apr 14 16:19:29.333205 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 555/1115] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Apr 14 16:19:29 2021] GET /compute/v2.1/os-volumes/3b9929d9-9e28-440a-b4e8-e16b6681f2db => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:19:29.345444 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-645f9ffe-49d3-4cd6-a96b-f9ac49d0b281 tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] Calling method '.version_select at 0x7ff58ca322f0>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:29.444448 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-645f9ffe-49d3-4cd6-a96b-f9ac49d0b281 tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3b9929d9-9e28-440a-b4e8-e16b6681f2db" status: 200 len: 353 microversion: 2.1 time: 0.102799 Apr 14 16:19:29.445099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 561/1116] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Apr 14 16:19:29 2021] GET /compute/v2.1/os-volumes/3b9929d9-9e28-440a-b4e8-e16b6681f2db => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:19:29.463598 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-95f26c33-9917-498d-b4db-0458968c1e3c tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] Calling method '.version_select at 0x7ff58d1e6510>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:29.565713 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-95f26c33-9917-498d-b4db-0458968c1e3c tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/3b9929d9-9e28-440a-b4e8-e16b6681f2db" status: 202 len: 0 microversion: 2.1 time: 0.106130 Apr 14 16:19:29.569890 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 556/1117] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Apr 14 16:19:29 2021] DELETE /compute/v2.1/os-volumes/3b9929d9-9e28-440a-b4e8-e16b6681f2db => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:19:29.575609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-59e9a857-7679-4819-afe1-ddbdf02027a4 tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] Calling method '.version_select at 0x7ff58d6c0d08>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:29.676934 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-59e9a857-7679-4819-afe1-ddbdf02027a4 tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3b9929d9-9e28-440a-b4e8-e16b6681f2db" status: 200 len: 352 microversion: 2.1 time: 0.105478 Apr 14 16:19:29.677693 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 562/1118] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Apr 14 16:19:29 2021] GET /compute/v2.1/os-volumes/3b9929d9-9e28-440a-b4e8-e16b6681f2db => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:19:30.691086 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3023387f-32b2-48e7-b95e-bd24d1faf816 tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] Calling method '.version_select at 0x7ff58e0acae8>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:30.754545 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-3023387f-32b2-48e7-b95e-bd24d1faf816 tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] HTTP exception thrown: Volume 3b9929d9-9e28-440a-b4e8-e16b6681f2db could not be found. Apr 14 16:19:30.755211 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3023387f-32b2-48e7-b95e-bd24d1faf816 tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] Returning 404 to user: Volume 3b9929d9-9e28-440a-b4e8-e16b6681f2db could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:19:30.756118 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3023387f-32b2-48e7-b95e-bd24d1faf816 tempest-VolumesGetTestJSON-1983478084 tempest-VolumesGetTestJSON-1983478084-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3b9929d9-9e28-440a-b4e8-e16b6681f2db" status: 404 len: 109 microversion: 2.1 time: 0.069150 Apr 14 16:19:30.757477 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 557/1119] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Apr 14 16:19:30 2021] GET /compute/v2.1/os-volumes/3b9929d9-9e28-440a-b4e8-e16b6681f2db => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:19:45.352818 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:19:45.353344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: Wed Apr 14 16:19:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 14 16:19:46.782441 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ed3f56c0-4ede-4716-9be6-b6d014efe996 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:46.782995 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ed3f56c0-4ede-4716-9be6-b6d014efe996 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:46.791034 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ed3f56c0-4ede-4716-9be6-b6d014efe996 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:46.791540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ed3f56c0-4ede-4716-9be6-b6d014efe996 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:46.792380 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ed3f56c0-4ede-4716-9be6-b6d014efe996 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:46.792878 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ed3f56c0-4ede-4716-9be6-b6d014efe996 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:46.862631 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ed3f56c0-4ede-4716-9be6-b6d014efe996 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Going to try to terminate instance {{(pid=99335) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:19:46.978959 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ed3f56c0-4ede-4716-9be6-b6d014efe996 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "DELETE /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 204 len: 0 microversion: 2.20 time: 0.200460 Apr 14 16:19:46.980249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 563/1120] 10.222.0.60 () {60 vars in 1270 bytes} [Wed Apr 14 16:19:46 2021] DELETE /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 16:19:46.989355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c86c83d4-58eb-4472-ad91-6758ded394dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:46.990113 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c86c83d4-58eb-4472-ad91-6758ded394dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:46.998390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c86c83d4-58eb-4472-ad91-6758ded394dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:46.999009 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c86c83d4-58eb-4472-ad91-6758ded394dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:46.999926 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c86c83d4-58eb-4472-ad91-6758ded394dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:47.000490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c86c83d4-58eb-4472-ad91-6758ded394dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:47.200884 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c86c83d4-58eb-4472-ad91-6758ded394dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:47.210410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c86c83d4-58eb-4472-ad91-6758ded394dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:47.212087 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c86c83d4-58eb-4472-ad91-6758ded394dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:47.213358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c86c83d4-58eb-4472-ad91-6758ded394dd tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1723 microversion: 2.20 time: 0.228819 Apr 14 16:19:47.213974 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 558/1121] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:19:46 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:19:48.234116 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-900c9d41-5b6d-48fb-bb82-28f63a2d966c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:48.234935 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-900c9d41-5b6d-48fb-bb82-28f63a2d966c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:48.243137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-900c9d41-5b6d-48fb-bb82-28f63a2d966c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:48.243649 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-900c9d41-5b6d-48fb-bb82-28f63a2d966c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:48.244483 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-900c9d41-5b6d-48fb-bb82-28f63a2d966c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:48.244979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-900c9d41-5b6d-48fb-bb82-28f63a2d966c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:48.653701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-900c9d41-5b6d-48fb-bb82-28f63a2d966c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:48.663778 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-900c9d41-5b6d-48fb-bb82-28f63a2d966c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:48.665564 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-900c9d41-5b6d-48fb-bb82-28f63a2d966c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:48.666843 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-900c9d41-5b6d-48fb-bb82-28f63a2d966c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1723 microversion: 2.20 time: 0.437421 Apr 14 16:19:48.667495 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 564/1122] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:19:48 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1723 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:19:49.686686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c1fe430b-038a-478e-9441-4f2d90449433 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:49.687266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c1fe430b-038a-478e-9441-4f2d90449433 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:49.696674 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1fe430b-038a-478e-9441-4f2d90449433 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:49.697213 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1fe430b-038a-478e-9441-4f2d90449433 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:49.698070 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1fe430b-038a-478e-9441-4f2d90449433 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:49.698568 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c1fe430b-038a-478e-9441-4f2d90449433 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:49.936436 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c1fe430b-038a-478e-9441-4f2d90449433 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:49.946138 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c1fe430b-038a-478e-9441-4f2d90449433 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:49.947748 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c1fe430b-038a-478e-9441-4f2d90449433 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:49.948987 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c1fe430b-038a-478e-9441-4f2d90449433 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1656 microversion: 2.20 time: 0.266581 Apr 14 16:19:49.949636 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 559/1123] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:19:49 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1656 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:19:50.595109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-826d200f-20a3-489e-acc7-d4ad1b061dfd req-e36f4e9d-b40b-487a-b56e-91853b58dad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e45e06-d4ec-48d7-8576-da008e2a2bbe", "name": "network-vif-deleted", "tag": "86985f08-70cd-4417-8f18-ff0ada9a82ff"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:19:50.596895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:19:50.596895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:19:50.614531 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-826d200f-20a3-489e-acc7-d4ad1b061dfd req-e36f4e9d-b40b-487a-b56e-91853b58dad1 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:50.615042 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-826d200f-20a3-489e-acc7-d4ad1b061dfd req-e36f4e9d-b40b-487a-b56e-91853b58dad1 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:50.634703 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-826d200f-20a3-489e-acc7-d4ad1b061dfd req-e36f4e9d-b40b-487a-b56e-91853b58dad1 service nova] Creating event network-vif-deleted:86985f08-70cd-4417-8f18-ff0ada9a82ff for instance 67e45e06-d4ec-48d7-8576-da008e2a2bbe on hv-cinder-78626 Apr 14 16:19:50.640336 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-826d200f-20a3-489e-acc7-d4ad1b061dfd req-e36f4e9d-b40b-487a-b56e-91853b58dad1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049350 Apr 14 16:19:50.641006 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 565/1124] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:19:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:19:50.968234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fbb653df-761d-4461-b175-4825adc7f33d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:50.969271 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fbb653df-761d-4461-b175-4825adc7f33d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:50.977529 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fbb653df-761d-4461-b175-4825adc7f33d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:50.978039 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fbb653df-761d-4461-b175-4825adc7f33d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:50.979049 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fbb653df-761d-4461-b175-4825adc7f33d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:50.979664 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fbb653df-761d-4461-b175-4825adc7f33d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:51.061061 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fbb653df-761d-4461-b175-4825adc7f33d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:51.061607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fbb653df-761d-4461-b175-4825adc7f33d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:51.062644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-fbb653df-761d-4461-b175-4825adc7f33d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lazy-loading 'fault' on Instance uuid 67e45e06-d4ec-48d7-8576-da008e2a2bbe {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:19:51.149386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fbb653df-761d-4461-b175-4825adc7f33d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:51.158346 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fbb653df-761d-4461-b175-4825adc7f33d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:51.160028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fbb653df-761d-4461-b175-4825adc7f33d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01801b3a85a648fb94444e671cbb4d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c32c45b97f24aafbfc72c32f2ee651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:19:51.161278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fbb653df-761d-4461-b175-4825adc7f33d tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 200 len: 1370 microversion: 2.20 time: 0.197229 Apr 14 16:19:51.162157 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 560/1125] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:19:50 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:19:52.182350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d50f5344-79b9-41a7-9986-7e547924c6df tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:52.183241 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d50f5344-79b9-41a7-9986-7e547924c6df tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:52.191542 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d50f5344-79b9-41a7-9986-7e547924c6df tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:52.192058 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d50f5344-79b9-41a7-9986-7e547924c6df tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:52.192903 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d50f5344-79b9-41a7-9986-7e547924c6df tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:52.193433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d50f5344-79b9-41a7-9986-7e547924c6df tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:52.250435 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-d50f5344-79b9-41a7-9986-7e547924c6df tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] HTTP exception thrown: Instance 67e45e06-d4ec-48d7-8576-da008e2a2bbe could not be found. Apr 14 16:19:52.251106 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d50f5344-79b9-41a7-9986-7e547924c6df tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Returning 404 to user: Instance 67e45e06-d4ec-48d7-8576-da008e2a2bbe could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:19:52.252065 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d50f5344-79b9-41a7-9986-7e547924c6df tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 404 len: 111 microversion: 2.20 time: 0.074446 Apr 14 16:19:52.252638 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 566/1126] 10.222.0.60 () {60 vars in 1267 bytes} [Wed Apr 14 16:19:52 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 16:19:52.262176 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9421e31d-5efe-4eb9-b6d4-d34b3b378c1c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '.version_select at 0x7ff58d1e69d8>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:52.283174 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9421e31d-5efe-4eb9-b6d4-d34b3b378c1c tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-480869655" status: 204 len: 0 microversion: 2.20 time: 0.025005 Apr 14 16:19:52.283957 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 561/1127] 10.222.0.60 () {60 vars in 1249 bytes} [Wed Apr 14 16:19:52 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-480869655 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 16:19:54.714969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7d57bd27-960e-46af-8e90-53274673c6a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:54.715588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7d57bd27-960e-46af-8e90-53274673c6a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:54.723434 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d57bd27-960e-46af-8e90-53274673c6a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:54.723939 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d57bd27-960e-46af-8e90-53274673c6a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:54.724762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d57bd27-960e-46af-8e90-53274673c6a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:54.725281 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7d57bd27-960e-46af-8e90-53274673c6a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:54.778675 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-7d57bd27-960e-46af-8e90-53274673c6a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] HTTP exception thrown: Instance 67e45e06-d4ec-48d7-8576-da008e2a2bbe could not be found. Apr 14 16:19:54.779324 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7d57bd27-960e-46af-8e90-53274673c6a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Returning 404 to user: Instance 67e45e06-d4ec-48d7-8576-da008e2a2bbe could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:19:54.780216 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7d57bd27-960e-46af-8e90-53274673c6a9 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "DELETE /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 404 len: 111 microversion: 2.1 time: 0.069598 Apr 14 16:19:54.780802 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 567/1128] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:19:54 2021] DELETE /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:19:54.790654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cfdf08b7-48e6-49a4-8636-9d86536ca3e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:54.791328 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cfdf08b7-48e6-49a4-8636-9d86536ca3e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 67e45e06-d4ec-48d7-8576-da008e2a2bbe] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:54.799251 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cfdf08b7-48e6-49a4-8636-9d86536ca3e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:54.799755 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cfdf08b7-48e6-49a4-8636-9d86536ca3e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:54.800593 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cfdf08b7-48e6-49a4-8636-9d86536ca3e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:54.801126 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cfdf08b7-48e6-49a4-8636-9d86536ca3e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:54.856167 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-cfdf08b7-48e6-49a4-8636-9d86536ca3e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] HTTP exception thrown: Instance 67e45e06-d4ec-48d7-8576-da008e2a2bbe could not be found. Apr 14 16:19:54.856833 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cfdf08b7-48e6-49a4-8636-9d86536ca3e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Returning 404 to user: Instance 67e45e06-d4ec-48d7-8576-da008e2a2bbe could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:19:54.857763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cfdf08b7-48e6-49a4-8636-9d86536ca3e5 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe" status: 404 len: 111 microversion: 2.1 time: 0.072310 Apr 14 16:19:54.858364 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 562/1129] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:19:54 2021] GET /compute/v2.1/servers/67e45e06-d4ec-48d7-8576-da008e2a2bbe => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:19:56.107786 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fd36c799-baa6-4912-a1d5-e2eaf70f2739 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:56.108351 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fd36c799-baa6-4912-a1d5-e2eaf70f2739 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:56.116445 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fd36c799-baa6-4912-a1d5-e2eaf70f2739 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:56.117010 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fd36c799-baa6-4912-a1d5-e2eaf70f2739 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:56.118540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fd36c799-baa6-4912-a1d5-e2eaf70f2739 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:56.119048 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fd36c799-baa6-4912-a1d5-e2eaf70f2739 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:56.173192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-fd36c799-baa6-4912-a1d5-e2eaf70f2739 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] HTTP exception thrown: Instance 97e83f61-2715-436f-8d7c-88c4483cc0e5 could not be found. Apr 14 16:19:56.173876 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fd36c799-baa6-4912-a1d5-e2eaf70f2739 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Returning 404 to user: Instance 97e83f61-2715-436f-8d7c-88c4483cc0e5 could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:19:56.174797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fd36c799-baa6-4912-a1d5-e2eaf70f2739 tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "DELETE /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 404 len: 111 microversion: 2.1 time: 0.071061 Apr 14 16:19:56.175417 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 568/1130] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:19:56 2021] DELETE /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:19:56.185637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c87cf370-0c34-4978-916e-2c20837de63f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:19:56.186310 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c87cf370-0c34-4978-916e-2c20837de63f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] [instance: 97e83f61-2715-436f-8d7c-88c4483cc0e5] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:19:56.194383 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c87cf370-0c34-4978-916e-2c20837de63f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:56.194890 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c87cf370-0c34-4978-916e-2c20837de63f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:56.196101 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c87cf370-0c34-4978-916e-2c20837de63f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:19:56.196601 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c87cf370-0c34-4978-916e-2c20837de63f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:19:56.253647 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-c87cf370-0c34-4978-916e-2c20837de63f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] HTTP exception thrown: Instance 97e83f61-2715-436f-8d7c-88c4483cc0e5 could not be found. Apr 14 16:19:56.254318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c87cf370-0c34-4978-916e-2c20837de63f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] Returning 404 to user: Instance 97e83f61-2715-436f-8d7c-88c4483cc0e5 could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:19:56.255229 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c87cf370-0c34-4978-916e-2c20837de63f tempest-AttachVolumeShelveTestJSON-628745324 tempest-AttachVolumeShelveTestJSON-628745324-project] 10.222.0.60 "GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5" status: 404 len: 111 microversion: 2.1 time: 0.075325 Apr 14 16:19:56.255853 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 563/1131] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:19:56 2021] GET /compute/v2.1/servers/97e83f61-2715-436f-8d7c-88c4483cc0e5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:20:13.683561 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1125377775", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-643900673", "security_groups": [{"name": "tempest-secgroup-smoke-944231262"}], "block_device_mapping_v2": [{"uuid": "8697fc30-c737-4868-aef5-faf89132db77", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f231942-4227-4866-b347-c39ce3e77e17"}]}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:20:13.834530 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] validate_networks() for [('7f231942-4227-4866-b347-c39ce3e77e17', None, None, None)] {{(pid=99335) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:20:14.407126 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Flavor limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:20:14.407641 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Image limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:20:14.408167 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Flavor pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:20:14.408782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Image pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:20:14.409308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:20:14.419066 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:14.419676 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:14.420543 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:14.421053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:14.439875 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Getting quotas for project ed9d2e253f144da0bf1bbc63b4657b81. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:20:14.444203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Getting quotas for user c9637a87d0cc41bb87b2437326c01992 and project ed9d2e253f144da0bf1bbc63b4657b81. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:20:14.558505 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Going to run 1 instances... {{(pid=99335) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:20:14.561069 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8697fc30-c737-4868-aef5-faf89132db77',volume_size=None,volume_type=None)] {{(pid=99335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:20:14.744817 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-cd289376-0767-456b-985f-4753662d4962 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.065837 Apr 14 16:20:14.745780 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 569/1132] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:20:13 2021] POST /compute/v2.1/servers => generated 405 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:20:14.756558 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-04703319-a789-433d-825d-30a6987f93e2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:14.757928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-04703319-a789-433d-825d-30a6987f93e2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:14.843252 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-04703319-a789-433d-825d-30a6987f93e2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:14.851435 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-04703319-a789-433d-825d-30a6987f93e2 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1094 microversion: 2.1 time: 0.099097 Apr 14 16:20:14.852062 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 564/1133] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:14 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:15.870240 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f1f45591-02e0-4bcb-b787-c5630cdedb8d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:15.870917 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f1f45591-02e0-4bcb-b787-c5630cdedb8d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:15.879612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1f45591-02e0-4bcb-b787-c5630cdedb8d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:15.880128 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1f45591-02e0-4bcb-b787-c5630cdedb8d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:15.880974 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1f45591-02e0-4bcb-b787-c5630cdedb8d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:15.881502 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1f45591-02e0-4bcb-b787-c5630cdedb8d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:16.007360 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f1f45591-02e0-4bcb-b787-c5630cdedb8d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:16.016278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f1f45591-02e0-4bcb-b787-c5630cdedb8d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1144 microversion: 2.1 time: 0.150752 Apr 14 16:20:16.016915 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 570/1134] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:15 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1144 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:17.035191 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1466695e-c05b-4c5a-a829-92ba4f62a31e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:17.036218 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1466695e-c05b-4c5a-a829-92ba4f62a31e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:17.045714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1466695e-c05b-4c5a-a829-92ba4f62a31e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:17.046312 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1466695e-c05b-4c5a-a829-92ba4f62a31e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:17.047562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1466695e-c05b-4c5a-a829-92ba4f62a31e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:17.048103 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1466695e-c05b-4c5a-a829-92ba4f62a31e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:17.199853 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1466695e-c05b-4c5a-a829-92ba4f62a31e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:17.209028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1466695e-c05b-4c5a-a829-92ba4f62a31e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1200 microversion: 2.1 time: 0.178148 Apr 14 16:20:17.209620 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 565/1135] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:17 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1200 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:18.228557 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-70c2efc4-c1fe-4daa-a9b6-3c3fcfef0bc4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:18.229395 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-70c2efc4-c1fe-4daa-a9b6-3c3fcfef0bc4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:18.237894 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70c2efc4-c1fe-4daa-a9b6-3c3fcfef0bc4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:18.238562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70c2efc4-c1fe-4daa-a9b6-3c3fcfef0bc4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:18.239508 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70c2efc4-c1fe-4daa-a9b6-3c3fcfef0bc4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:18.240087 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-70c2efc4-c1fe-4daa-a9b6-3c3fcfef0bc4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:18.457774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-70c2efc4-c1fe-4daa-a9b6-3c3fcfef0bc4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:18.467739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-70c2efc4-c1fe-4daa-a9b6-3c3fcfef0bc4 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1265 microversion: 2.1 time: 0.243965 Apr 14 16:20:18.468377 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 571/1136] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:18 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:19.486204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-59f16d04-a3c6-4fcb-98b0-0e078fd1ca9d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:19.486746 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-59f16d04-a3c6-4fcb-98b0-0e078fd1ca9d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:19.495469 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59f16d04-a3c6-4fcb-98b0-0e078fd1ca9d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:19.495974 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59f16d04-a3c6-4fcb-98b0-0e078fd1ca9d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:19.496797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59f16d04-a3c6-4fcb-98b0-0e078fd1ca9d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:19.497316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-59f16d04-a3c6-4fcb-98b0-0e078fd1ca9d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:19.709459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-59f16d04-a3c6-4fcb-98b0-0e078fd1ca9d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:19.719106 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-59f16d04-a3c6-4fcb-98b0-0e078fd1ca9d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1265 microversion: 2.1 time: 0.236986 Apr 14 16:20:19.719732 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 566/1137] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:19 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:20.737882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f0c8ced7-4b9f-42c3-9326-7c7c647d55a8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:20.738551 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f0c8ced7-4b9f-42c3-9326-7c7c647d55a8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:20.747370 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f0c8ced7-4b9f-42c3-9326-7c7c647d55a8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:20.747879 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f0c8ced7-4b9f-42c3-9326-7c7c647d55a8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:20.748713 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f0c8ced7-4b9f-42c3-9326-7c7c647d55a8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:20.749252 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f0c8ced7-4b9f-42c3-9326-7c7c647d55a8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:20.946927 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f0c8ced7-4b9f-42c3-9326-7c7c647d55a8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:20.955979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f0c8ced7-4b9f-42c3-9326-7c7c647d55a8 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1265 microversion: 2.1 time: 0.222203 Apr 14 16:20:20.956628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 572/1138] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:20 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:21.479642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-ab23e179-2446-4e21-bb96-d7845cd189cb req-28890aa4-37a1-4d52-9afe-f7adf3b41e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d409a4ad-aebe-4041-bbfc-6b76520d6d02", "tag": "312d4cc5-7239-4df5-b7ed-2b4bf3f5dbbb"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:20:21.481496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:20:21.481496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:20:21.490647 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-ab23e179-2446-4e21-bb96-d7845cd189cb req-28890aa4-37a1-4d52-9afe-f7adf3b41e4a service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:21.491153 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-ab23e179-2446-4e21-bb96-d7845cd189cb req-28890aa4-37a1-4d52-9afe-f7adf3b41e4a service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:21.510390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-ab23e179-2446-4e21-bb96-d7845cd189cb req-28890aa4-37a1-4d52-9afe-f7adf3b41e4a service nova] Creating event network-changed:312d4cc5-7239-4df5-b7ed-2b4bf3f5dbbb for instance d409a4ad-aebe-4041-bbfc-6b76520d6d02 on hv-cinder-78626 Apr 14 16:20:21.516210 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-ab23e179-2446-4e21-bb96-d7845cd189cb req-28890aa4-37a1-4d52-9afe-f7adf3b41e4a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041681 Apr 14 16:20:21.517323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 567/1139] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:20:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:20:21.973808 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ccf1125b-b8d8-4ecd-8811-4844aa2b1536 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:21.974461 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ccf1125b-b8d8-4ecd-8811-4844aa2b1536 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:21.982462 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccf1125b-b8d8-4ecd-8811-4844aa2b1536 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:21.982963 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccf1125b-b8d8-4ecd-8811-4844aa2b1536 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:21.983794 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccf1125b-b8d8-4ecd-8811-4844aa2b1536 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:21.984282 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ccf1125b-b8d8-4ecd-8811-4844aa2b1536 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:22.203341 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ccf1125b-b8d8-4ecd-8811-4844aa2b1536 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:22.212391 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ccf1125b-b8d8-4ecd-8811-4844aa2b1536 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1265 microversion: 2.1 time: 0.242511 Apr 14 16:20:22.213017 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 573/1140] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:21 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:23.231171 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-367500c7-0a4f-40fe-bad7-34c1feb1495a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:23.231946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-367500c7-0a4f-40fe-bad7-34c1feb1495a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:23.240055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-367500c7-0a4f-40fe-bad7-34c1feb1495a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:23.240565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-367500c7-0a4f-40fe-bad7-34c1feb1495a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:23.241438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-367500c7-0a4f-40fe-bad7-34c1feb1495a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:23.241934 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-367500c7-0a4f-40fe-bad7-34c1feb1495a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:23.507287 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-367500c7-0a4f-40fe-bad7-34c1feb1495a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:23.516777 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-367500c7-0a4f-40fe-bad7-34c1feb1495a tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1265 microversion: 2.1 time: 0.290332 Apr 14 16:20:23.517485 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 568/1141] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:23 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:24.535189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-26612ddc-38a5-4a03-a78a-d2e9e60355e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:24.535946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-26612ddc-38a5-4a03-a78a-d2e9e60355e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:24.544642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26612ddc-38a5-4a03-a78a-d2e9e60355e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:24.545211 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26612ddc-38a5-4a03-a78a-d2e9e60355e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:24.546110 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26612ddc-38a5-4a03-a78a-d2e9e60355e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:24.546614 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-26612ddc-38a5-4a03-a78a-d2e9e60355e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:24.748751 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-26612ddc-38a5-4a03-a78a-d2e9e60355e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:24.757718 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-26612ddc-38a5-4a03-a78a-d2e9e60355e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1265 microversion: 2.1 time: 0.226943 Apr 14 16:20:24.758753 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 574/1142] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:24 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:25.776546 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2419b246-9353-4925-89b6-41bf143c46ca tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:25.777609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2419b246-9353-4925-89b6-41bf143c46ca tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:25.786805 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2419b246-9353-4925-89b6-41bf143c46ca tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:25.787302 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2419b246-9353-4925-89b6-41bf143c46ca tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:25.788775 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2419b246-9353-4925-89b6-41bf143c46ca tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:25.789318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2419b246-9353-4925-89b6-41bf143c46ca tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:26.047484 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2419b246-9353-4925-89b6-41bf143c46ca tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:26.061327 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2419b246-9353-4925-89b6-41bf143c46ca tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1265 microversion: 2.1 time: 0.289102 Apr 14 16:20:26.062224 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 569/1143] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:25 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:27.084177 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1eae7268-073e-4c05-95fe-4564a240a462 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:27.087993 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1eae7268-073e-4c05-95fe-4564a240a462 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:27.103980 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1eae7268-073e-4c05-95fe-4564a240a462 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:27.104682 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1eae7268-073e-4c05-95fe-4564a240a462 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:27.106668 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1eae7268-073e-4c05-95fe-4564a240a462 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:27.107322 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1eae7268-073e-4c05-95fe-4564a240a462 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:27.335234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1eae7268-073e-4c05-95fe-4564a240a462 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:27.344374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1eae7268-073e-4c05-95fe-4564a240a462 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1265 microversion: 2.1 time: 0.264572 Apr 14 16:20:27.352895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 575/1144] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:27 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:27.732490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-941732a7-e905-45c6-a72f-c8cc06e18d6f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:20:27.733101 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-941732a7-e905-45c6-a72f-c8cc06e18d6f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:27.741023 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-941732a7-e905-45c6-a72f-c8cc06e18d6f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:27.741565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-941732a7-e905-45c6-a72f-c8cc06e18d6f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:27.742410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-941732a7-e905-45c6-a72f-c8cc06e18d6f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:27.743062 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-941732a7-e905-45c6-a72f-c8cc06e18d6f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:27.804563 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-941732a7-e905-45c6-a72f-c8cc06e18d6f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lazy-loading 'flavor' on Instance uuid ec37842c-337c-481a-b350-8055f911d09b {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:20:27.959926 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-941732a7-e905-45c6-a72f-c8cc06e18d6f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "POST /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b/action" status: 202 len: 0 microversion: 2.1 time: 0.231324 Apr 14 16:20:27.964260 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 570/1145] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:20:27 2021] POST /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:20:27.970638 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7a9fb95c-4a4b-40b4-b4da-7bc81640e482 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:27.971315 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7a9fb95c-4a4b-40b4-b4da-7bc81640e482 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:27.981609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7a9fb95c-4a4b-40b4-b4da-7bc81640e482 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:27.981609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7a9fb95c-4a4b-40b4-b4da-7bc81640e482 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:27.984559 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7a9fb95c-4a4b-40b4-b4da-7bc81640e482 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:27.985126 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7a9fb95c-4a4b-40b4-b4da-7bc81640e482 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:28.206630 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7a9fb95c-4a4b-40b4-b4da-7bc81640e482 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:28.218566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7a9fb95c-4a4b-40b4-b4da-7bc81640e482 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.251703 Apr 14 16:20:28.219246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 576/1146] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:27 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:28.362888 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a2342aef-0da0-4282-a42d-65a3b626c19d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:28.364506 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a2342aef-0da0-4282-a42d-65a3b626c19d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:28.373414 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2342aef-0da0-4282-a42d-65a3b626c19d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:28.374151 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2342aef-0da0-4282-a42d-65a3b626c19d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:28.374992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2342aef-0da0-4282-a42d-65a3b626c19d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:28.375680 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a2342aef-0da0-4282-a42d-65a3b626c19d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:28.590715 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a2342aef-0da0-4282-a42d-65a3b626c19d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:28.601674 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a2342aef-0da0-4282-a42d-65a3b626c19d tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1265 microversion: 2.1 time: 0.243460 Apr 14 16:20:28.602707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 571/1147] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:28 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:29.237795 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2e96b213-db94-4dd2-9627-d4643dddcdb1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:29.238436 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2e96b213-db94-4dd2-9627-d4643dddcdb1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:29.247416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2e96b213-db94-4dd2-9627-d4643dddcdb1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:29.247927 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2e96b213-db94-4dd2-9627-d4643dddcdb1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:29.248767 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2e96b213-db94-4dd2-9627-d4643dddcdb1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:29.249286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2e96b213-db94-4dd2-9627-d4643dddcdb1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:29.462945 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2e96b213-db94-4dd2-9627-d4643dddcdb1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:29.472517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2e96b213-db94-4dd2-9627-d4643dddcdb1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.238654 Apr 14 16:20:29.473149 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 577/1148] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:29 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:29.620837 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7e3ad123-0951-4a6b-9697-5780505d5b79 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:29.622025 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7e3ad123-0951-4a6b-9697-5780505d5b79 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:29.633344 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7e3ad123-0951-4a6b-9697-5780505d5b79 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:29.638873 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7e3ad123-0951-4a6b-9697-5780505d5b79 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:29.640276 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7e3ad123-0951-4a6b-9697-5780505d5b79 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:29.641270 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7e3ad123-0951-4a6b-9697-5780505d5b79 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:29.878262 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7e3ad123-0951-4a6b-9697-5780505d5b79 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:29.889707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7e3ad123-0951-4a6b-9697-5780505d5b79 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1265 microversion: 2.1 time: 0.273477 Apr 14 16:20:29.900913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 572/1149] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:29 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:30.491996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7a9e15b4-bb1a-4282-af95-6b78e03ec227 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:30.492844 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7a9e15b4-bb1a-4282-af95-6b78e03ec227 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:30.500928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7a9e15b4-bb1a-4282-af95-6b78e03ec227 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:30.501481 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7a9e15b4-bb1a-4282-af95-6b78e03ec227 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:30.502323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7a9e15b4-bb1a-4282-af95-6b78e03ec227 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:30.502819 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7a9e15b4-bb1a-4282-af95-6b78e03ec227 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:30.712865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7a9e15b4-bb1a-4282-af95-6b78e03ec227 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:30.721720 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7a9e15b4-bb1a-4282-af95-6b78e03ec227 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.233937 Apr 14 16:20:30.722356 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 578/1150] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:30 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:30.908512 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-da457592-dfde-40e7-9c58-aeb72dadef32 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:30.909299 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-da457592-dfde-40e7-9c58-aeb72dadef32 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:30.917698 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da457592-dfde-40e7-9c58-aeb72dadef32 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:30.918203 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da457592-dfde-40e7-9c58-aeb72dadef32 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:30.919031 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da457592-dfde-40e7-9c58-aeb72dadef32 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:30.919520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-da457592-dfde-40e7-9c58-aeb72dadef32 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:31.118328 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-da457592-dfde-40e7-9c58-aeb72dadef32 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:31.127498 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-da457592-dfde-40e7-9c58-aeb72dadef32 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1265 microversion: 2.1 time: 0.223358 Apr 14 16:20:31.128380 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 573/1151] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:30 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:31.739982 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0cb31e50-89df-4f25-b056-660a6321109a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:31.741231 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0cb31e50-89df-4f25-b056-660a6321109a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:31.750678 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0cb31e50-89df-4f25-b056-660a6321109a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:31.751491 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0cb31e50-89df-4f25-b056-660a6321109a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:31.752570 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0cb31e50-89df-4f25-b056-660a6321109a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:31.753299 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0cb31e50-89df-4f25-b056-660a6321109a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:31.769587 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-378892d9-9c53-4837-b106-008d49bbcffd req-6b08d4fd-98b7-470d-bc83-515e652bbd6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d409a4ad-aebe-4041-bbfc-6b76520d6d02", "name": "network-vif-plugged", "status": "completed", "tag": "312d4cc5-7239-4df5-b7ed-2b4bf3f5dbbb"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:20:31.771569 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:20:31.771569 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:20:31.792890 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-378892d9-9c53-4837-b106-008d49bbcffd req-6b08d4fd-98b7-470d-bc83-515e652bbd6a service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:31.793793 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-378892d9-9c53-4837-b106-008d49bbcffd req-6b08d4fd-98b7-470d-bc83-515e652bbd6a service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:31.832460 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-378892d9-9c53-4837-b106-008d49bbcffd req-6b08d4fd-98b7-470d-bc83-515e652bbd6a service nova] Creating event network-vif-plugged:312d4cc5-7239-4df5-b7ed-2b4bf3f5dbbb for instance d409a4ad-aebe-4041-bbfc-6b76520d6d02 on hv-cinder-78626 Apr 14 16:20:31.846991 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-378892d9-9c53-4837-b106-008d49bbcffd req-6b08d4fd-98b7-470d-bc83-515e652bbd6a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082006 Apr 14 16:20:31.847893 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 574/1152] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:20:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:20:32.024687 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0cb31e50-89df-4f25-b056-660a6321109a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:32.035754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0cb31e50-89df-4f25-b056-660a6321109a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.299881 Apr 14 16:20:32.036791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 579/1153] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:31 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:32.147685 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-162dd2a3-9eae-4352-8952-5e73195c2d14 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:32.148480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-162dd2a3-9eae-4352-8952-5e73195c2d14 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:32.157860 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-162dd2a3-9eae-4352-8952-5e73195c2d14 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:32.158350 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-162dd2a3-9eae-4352-8952-5e73195c2d14 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:32.159420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-162dd2a3-9eae-4352-8952-5e73195c2d14 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:32.159929 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-162dd2a3-9eae-4352-8952-5e73195c2d14 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:32.581643 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-162dd2a3-9eae-4352-8952-5e73195c2d14 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:32.590911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-162dd2a3-9eae-4352-8952-5e73195c2d14 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1265 microversion: 2.1 time: 0.447759 Apr 14 16:20:32.591553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 575/1154] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:32 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1265 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:33.055644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f1e8dcb8-7ff5-4671-babf-88495c2c6534 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:33.056326 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f1e8dcb8-7ff5-4671-babf-88495c2c6534 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:33.064343 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1e8dcb8-7ff5-4671-babf-88495c2c6534 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:33.064857 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1e8dcb8-7ff5-4671-babf-88495c2c6534 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:33.065723 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1e8dcb8-7ff5-4671-babf-88495c2c6534 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:33.066228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f1e8dcb8-7ff5-4671-babf-88495c2c6534 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:33.267246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f1e8dcb8-7ff5-4671-babf-88495c2c6534 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:33.277000 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f1e8dcb8-7ff5-4671-babf-88495c2c6534 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.226073 Apr 14 16:20:33.277657 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 580/1155] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:33 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:33.608135 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a960801c-099e-485a-aa40-dab395c5cfeb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:33.608813 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a960801c-099e-485a-aa40-dab395c5cfeb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:33.616694 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a960801c-099e-485a-aa40-dab395c5cfeb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:33.617218 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a960801c-099e-485a-aa40-dab395c5cfeb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:33.618413 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a960801c-099e-485a-aa40-dab395c5cfeb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:33.619627 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a960801c-099e-485a-aa40-dab395c5cfeb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:33.823733 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a960801c-099e-485a-aa40-dab395c5cfeb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:33.832754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a960801c-099e-485a-aa40-dab395c5cfeb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1265 microversion: 2.1 time: 0.228678 Apr 14 16:20:33.833452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 576/1156] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:33 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:34.296495 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bdde1b95-d81f-4ef7-a676-f18dcd79e164 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:34.297219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bdde1b95-d81f-4ef7-a676-f18dcd79e164 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:34.306005 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdde1b95-d81f-4ef7-a676-f18dcd79e164 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:34.306322 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdde1b95-d81f-4ef7-a676-f18dcd79e164 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:34.307161 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdde1b95-d81f-4ef7-a676-f18dcd79e164 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:34.307655 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdde1b95-d81f-4ef7-a676-f18dcd79e164 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:34.508354 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bdde1b95-d81f-4ef7-a676-f18dcd79e164 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:34.517338 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bdde1b95-d81f-4ef7-a676-f18dcd79e164 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.224953 Apr 14 16:20:34.517981 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 581/1157] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:34 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:34.851674 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-664c7448-4e0f-4e82-b612-0d84d82b8745 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:34.852795 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-664c7448-4e0f-4e82-b612-0d84d82b8745 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:34.860648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-664c7448-4e0f-4e82-b612-0d84d82b8745 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:34.861174 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-664c7448-4e0f-4e82-b612-0d84d82b8745 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:34.861997 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-664c7448-4e0f-4e82-b612-0d84d82b8745 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:34.862482 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-664c7448-4e0f-4e82-b612-0d84d82b8745 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:35.061588 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-664c7448-4e0f-4e82-b612-0d84d82b8745 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:35.071110 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-664c7448-4e0f-4e82-b612-0d84d82b8745 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1265 microversion: 2.1 time: 0.223174 Apr 14 16:20:35.071758 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 577/1158] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:34 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:35.588076 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-213e7ea7-ddaf-45a7-8ddc-031740336a91 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:35.589792 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-213e7ea7-ddaf-45a7-8ddc-031740336a91 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:35.597992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-213e7ea7-ddaf-45a7-8ddc-031740336a91 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:35.599269 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-213e7ea7-ddaf-45a7-8ddc-031740336a91 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:35.599426 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-213e7ea7-ddaf-45a7-8ddc-031740336a91 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:35.599820 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-213e7ea7-ddaf-45a7-8ddc-031740336a91 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:35.801969 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-213e7ea7-ddaf-45a7-8ddc-031740336a91 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:35.816784 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-213e7ea7-ddaf-45a7-8ddc-031740336a91 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.232755 Apr 14 16:20:35.817533 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 582/1159] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:35 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:36.089003 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c44feb85-70cd-474c-a22c-3fea08b513db tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:36.090053 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c44feb85-70cd-474c-a22c-3fea08b513db tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:36.098446 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c44feb85-70cd-474c-a22c-3fea08b513db tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:36.098960 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c44feb85-70cd-474c-a22c-3fea08b513db tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:36.099807 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c44feb85-70cd-474c-a22c-3fea08b513db tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:36.100301 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c44feb85-70cd-474c-a22c-3fea08b513db tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:36.304430 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c44feb85-70cd-474c-a22c-3fea08b513db tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:36.313531 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c44feb85-70cd-474c-a22c-3fea08b513db tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1265 microversion: 2.1 time: 0.229536 Apr 14 16:20:36.314214 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 578/1160] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:36 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:36.835155 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-659ea8a9-e30e-4c17-aa98-26905686f2cf tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:36.835839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-659ea8a9-e30e-4c17-aa98-26905686f2cf tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:36.844045 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-659ea8a9-e30e-4c17-aa98-26905686f2cf tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:36.844547 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-659ea8a9-e30e-4c17-aa98-26905686f2cf tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:36.845408 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-659ea8a9-e30e-4c17-aa98-26905686f2cf tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:36.845897 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-659ea8a9-e30e-4c17-aa98-26905686f2cf tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:37.247758 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-659ea8a9-e30e-4c17-aa98-26905686f2cf tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:37.257077 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-659ea8a9-e30e-4c17-aa98-26905686f2cf tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.425902 Apr 14 16:20:37.257718 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 583/1161] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:36 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:37.331655 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-94391d3a-8c7f-4e58-8af5-52e685741d65 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:37.332321 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-94391d3a-8c7f-4e58-8af5-52e685741d65 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:37.341112 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94391d3a-8c7f-4e58-8af5-52e685741d65 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:37.341421 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94391d3a-8c7f-4e58-8af5-52e685741d65 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:37.342262 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94391d3a-8c7f-4e58-8af5-52e685741d65 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:37.342750 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-94391d3a-8c7f-4e58-8af5-52e685741d65 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:37.541746 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-94391d3a-8c7f-4e58-8af5-52e685741d65 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:37.550828 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-94391d3a-8c7f-4e58-8af5-52e685741d65 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1452 microversion: 2.1 time: 0.223213 Apr 14 16:20:37.551468 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 579/1162] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:37 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1452 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:37.567889 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-443d20d0-3e5c-4b6f-97be-8ca5d7145db1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:37.568562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-443d20d0-3e5c-4b6f-97be-8ca5d7145db1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:37.577288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-443d20d0-3e5c-4b6f-97be-8ca5d7145db1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:37.577796 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-443d20d0-3e5c-4b6f-97be-8ca5d7145db1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:37.578623 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-443d20d0-3e5c-4b6f-97be-8ca5d7145db1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:37.579115 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-443d20d0-3e5c-4b6f-97be-8ca5d7145db1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:37.810291 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-443d20d0-3e5c-4b6f-97be-8ca5d7145db1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:37.819157 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-443d20d0-3e5c-4b6f-97be-8ca5d7145db1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1452 microversion: 2.1 time: 0.255299 Apr 14 16:20:37.819799 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 584/1163] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:37 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1452 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:38.276658 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a4244143-8b97-4029-8bae-5484d1adc267 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:38.277532 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a4244143-8b97-4029-8bae-5484d1adc267 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:38.285853 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4244143-8b97-4029-8bae-5484d1adc267 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:38.286361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4244143-8b97-4029-8bae-5484d1adc267 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:38.287199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4244143-8b97-4029-8bae-5484d1adc267 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:38.287688 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4244143-8b97-4029-8bae-5484d1adc267 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:38.712443 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-a4244143-8b97-4029-8bae-5484d1adc267 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:38.722851 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a4244143-8b97-4029-8bae-5484d1adc267 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.450577 Apr 14 16:20:38.724650 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 580/1164] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:38 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:39.747933 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-40b3646b-0f7b-408f-8a96-ca56a391d54e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:39.749251 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-40b3646b-0f7b-408f-8a96-ca56a391d54e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:39.758390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40b3646b-0f7b-408f-8a96-ca56a391d54e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:39.758973 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40b3646b-0f7b-408f-8a96-ca56a391d54e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:39.760106 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40b3646b-0f7b-408f-8a96-ca56a391d54e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:39.760607 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-40b3646b-0f7b-408f-8a96-ca56a391d54e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:40.104852 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-40b3646b-0f7b-408f-8a96-ca56a391d54e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:40.116177 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-40b3646b-0f7b-408f-8a96-ca56a391d54e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.372212 Apr 14 16:20:40.143830 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 585/1165] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:39 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:41.139208 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1800ee64-eaf3-4e22-befa-8574894b0774 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:41.139208 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1800ee64-eaf3-4e22-befa-8574894b0774 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:41.145862 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1800ee64-eaf3-4e22-befa-8574894b0774 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:41.146708 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1800ee64-eaf3-4e22-befa-8574894b0774 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:41.147208 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1800ee64-eaf3-4e22-befa-8574894b0774 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:41.147697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1800ee64-eaf3-4e22-befa-8574894b0774 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:41.348626 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1800ee64-eaf3-4e22-befa-8574894b0774 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:41.358261 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1800ee64-eaf3-4e22-befa-8574894b0774 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.226663 Apr 14 16:20:41.358909 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 581/1166] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:41 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:41.475300 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-128dfd92-8fd8-47c1-b586-7bd63c5b0e9b req-ec7b294b-3d0c-47c5-97de-77e23fd82a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d409a4ad-aebe-4041-bbfc-6b76520d6d02", "tag": "312d4cc5-7239-4df5-b7ed-2b4bf3f5dbbb"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:20:41.478634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:20:41.478634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:20:41.487892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-128dfd92-8fd8-47c1-b586-7bd63c5b0e9b req-ec7b294b-3d0c-47c5-97de-77e23fd82a65 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:41.488392 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-128dfd92-8fd8-47c1-b586-7bd63c5b0e9b req-ec7b294b-3d0c-47c5-97de-77e23fd82a65 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:41.506703 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-128dfd92-8fd8-47c1-b586-7bd63c5b0e9b req-ec7b294b-3d0c-47c5-97de-77e23fd82a65 service nova] Creating event network-changed:312d4cc5-7239-4df5-b7ed-2b4bf3f5dbbb for instance d409a4ad-aebe-4041-bbfc-6b76520d6d02 on hv-cinder-78626 Apr 14 16:20:41.512582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-128dfd92-8fd8-47c1-b586-7bd63c5b0e9b req-ec7b294b-3d0c-47c5-97de-77e23fd82a65 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041623 Apr 14 16:20:41.513284 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 586/1167] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:20:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:20:41.571867 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:20:41.572149 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: Wed Apr 14 16:20:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 14 16:20:42.377316 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c56a978e-9515-45b8-835b-e1188941a65e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:42.378516 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c56a978e-9515-45b8-835b-e1188941a65e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:42.392908 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c56a978e-9515-45b8-835b-e1188941a65e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:42.396217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c56a978e-9515-45b8-835b-e1188941a65e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:42.397301 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c56a978e-9515-45b8-835b-e1188941a65e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:42.397964 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c56a978e-9515-45b8-835b-e1188941a65e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:42.660481 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c56a978e-9515-45b8-835b-e1188941a65e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:42.669677 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c56a978e-9515-45b8-835b-e1188941a65e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.296669 Apr 14 16:20:42.670315 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 582/1168] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:42 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:43.688534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-804ec91e-ebb0-4f5c-8c38-5202056d33ac tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:43.689986 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-804ec91e-ebb0-4f5c-8c38-5202056d33ac tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:43.698435 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-804ec91e-ebb0-4f5c-8c38-5202056d33ac tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:43.698939 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-804ec91e-ebb0-4f5c-8c38-5202056d33ac tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:43.699779 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-804ec91e-ebb0-4f5c-8c38-5202056d33ac tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:43.700268 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-804ec91e-ebb0-4f5c-8c38-5202056d33ac tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:43.900082 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-804ec91e-ebb0-4f5c-8c38-5202056d33ac tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:43.909847 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-804ec91e-ebb0-4f5c-8c38-5202056d33ac tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.225692 Apr 14 16:20:43.910483 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 587/1169] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:43 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:44.928731 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e2355f76-1899-4ffc-bfd9-f91fa9b49be0 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:44.929975 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e2355f76-1899-4ffc-bfd9-f91fa9b49be0 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:44.938280 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e2355f76-1899-4ffc-bfd9-f91fa9b49be0 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:44.938785 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e2355f76-1899-4ffc-bfd9-f91fa9b49be0 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:44.939612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e2355f76-1899-4ffc-bfd9-f91fa9b49be0 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:44.940099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e2355f76-1899-4ffc-bfd9-f91fa9b49be0 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:45.139870 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e2355f76-1899-4ffc-bfd9-f91fa9b49be0 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:45.149953 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e2355f76-1899-4ffc-bfd9-f91fa9b49be0 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.225258 Apr 14 16:20:45.150806 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 583/1170] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:44 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:46.168320 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9de7067b-8532-4181-a0e6-08954ad3820c tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:46.169692 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9de7067b-8532-4181-a0e6-08954ad3820c tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:46.177642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9de7067b-8532-4181-a0e6-08954ad3820c tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:46.178161 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9de7067b-8532-4181-a0e6-08954ad3820c tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:46.179012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9de7067b-8532-4181-a0e6-08954ad3820c tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:46.180047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9de7067b-8532-4181-a0e6-08954ad3820c tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:46.383338 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9de7067b-8532-4181-a0e6-08954ad3820c tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:46.392308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9de7067b-8532-4181-a0e6-08954ad3820c tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.228371 Apr 14 16:20:46.393095 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 588/1171] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:46 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:47.410835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8b852efa-625b-4c30-9a85-d4e881883140 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:47.411501 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8b852efa-625b-4c30-9a85-d4e881883140 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:47.419416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8b852efa-625b-4c30-9a85-d4e881883140 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:47.419913 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8b852efa-625b-4c30-9a85-d4e881883140 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:47.420747 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8b852efa-625b-4c30-9a85-d4e881883140 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:47.421279 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8b852efa-625b-4c30-9a85-d4e881883140 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:47.624232 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8b852efa-625b-4c30-9a85-d4e881883140 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:47.633800 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8b852efa-625b-4c30-9a85-d4e881883140 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.226909 Apr 14 16:20:47.634608 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 584/1172] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:47 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:48.652609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0c6f8f54-5877-48c3-9402-d46052f88b6d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:48.653232 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0c6f8f54-5877-48c3-9402-d46052f88b6d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:48.661201 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0c6f8f54-5877-48c3-9402-d46052f88b6d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:48.661707 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0c6f8f54-5877-48c3-9402-d46052f88b6d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:48.662526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0c6f8f54-5877-48c3-9402-d46052f88b6d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:48.663014 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0c6f8f54-5877-48c3-9402-d46052f88b6d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:48.862623 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0c6f8f54-5877-48c3-9402-d46052f88b6d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:48.872226 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0c6f8f54-5877-48c3-9402-d46052f88b6d tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.224388 Apr 14 16:20:48.872861 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 589/1173] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:48 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:49.890492 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9041b4b2-805f-434b-b489-5ce32f3668ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:49.891052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9041b4b2-805f-434b-b489-5ce32f3668ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:49.899391 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9041b4b2-805f-434b-b489-5ce32f3668ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:49.899892 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9041b4b2-805f-434b-b489-5ce32f3668ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:49.900715 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9041b4b2-805f-434b-b489-5ce32f3668ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:49.901227 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9041b4b2-805f-434b-b489-5ce32f3668ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:50.095369 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9041b4b2-805f-434b-b489-5ce32f3668ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:50.104760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9041b4b2-805f-434b-b489-5ce32f3668ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.218358 Apr 14 16:20:50.105420 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 585/1174] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:49 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:51.123943 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-810e7ecc-10ef-4958-949a-953988d9b567 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:51.124625 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-810e7ecc-10ef-4958-949a-953988d9b567 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:51.132866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-810e7ecc-10ef-4958-949a-953988d9b567 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:51.133414 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-810e7ecc-10ef-4958-949a-953988d9b567 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:51.134271 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-810e7ecc-10ef-4958-949a-953988d9b567 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:51.134774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-810e7ecc-10ef-4958-949a-953988d9b567 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:51.333824 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-810e7ecc-10ef-4958-949a-953988d9b567 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:51.343551 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-810e7ecc-10ef-4958-949a-953988d9b567 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.223734 Apr 14 16:20:51.344225 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 590/1175] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:51 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:52.190033 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-abcf1a31-02f3-4b33-912e-eada43215a85 req-37cfbe74-ceff-4fdf-83e6-e977552c9907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec37842c-337c-481a-b350-8055f911d09b", "name": "network-vif-unplugged", "status": "completed", "tag": "eb2c22c1-6bf1-4f7d-b0f0-ca1c076c35be"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:20:52.191854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:20:52.191854 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:20:52.201416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-abcf1a31-02f3-4b33-912e-eada43215a85 req-37cfbe74-ceff-4fdf-83e6-e977552c9907 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:52.201928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-abcf1a31-02f3-4b33-912e-eada43215a85 req-37cfbe74-ceff-4fdf-83e6-e977552c9907 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:52.219342 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-abcf1a31-02f3-4b33-912e-eada43215a85 req-37cfbe74-ceff-4fdf-83e6-e977552c9907 service nova] Creating event network-vif-unplugged:eb2c22c1-6bf1-4f7d-b0f0-ca1c076c35be for instance ec37842c-337c-481a-b350-8055f911d09b on hv-cinder-78626 Apr 14 16:20:52.224521 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-abcf1a31-02f3-4b33-912e-eada43215a85 req-37cfbe74-ceff-4fdf-83e6-e977552c9907 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038489 Apr 14 16:20:52.225201 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 586/1176] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:20:52 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:20:52.362378 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-926faafb-b0bc-4a29-9b76-77d2cbe68a36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:52.363054 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-926faafb-b0bc-4a29-9b76-77d2cbe68a36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:52.371696 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-926faafb-b0bc-4a29-9b76-77d2cbe68a36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:52.372206 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-926faafb-b0bc-4a29-9b76-77d2cbe68a36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:52.373063 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-926faafb-b0bc-4a29-9b76-77d2cbe68a36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:52.373549 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-926faafb-b0bc-4a29-9b76-77d2cbe68a36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:52.567447 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-926faafb-b0bc-4a29-9b76-77d2cbe68a36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:52.576436 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-926faafb-b0bc-4a29-9b76-77d2cbe68a36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.218090 Apr 14 16:20:52.577275 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 591/1177] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:52 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:53.595828 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f2719e64-e111-42be-935f-c8b43eaee721 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:53.596597 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f2719e64-e111-42be-935f-c8b43eaee721 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:53.605368 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f2719e64-e111-42be-935f-c8b43eaee721 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:53.605878 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f2719e64-e111-42be-935f-c8b43eaee721 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:53.606714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f2719e64-e111-42be-935f-c8b43eaee721 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:53.607204 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f2719e64-e111-42be-935f-c8b43eaee721 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:53.887640 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f2719e64-e111-42be-935f-c8b43eaee721 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:53.897057 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f2719e64-e111-42be-935f-c8b43eaee721 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1507 microversion: 2.1 time: 0.305686 Apr 14 16:20:53.897853 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 587/1178] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:53 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:53.915839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-31506fd4-fbd0-4d7a-aa82-cdea77e9c2fb tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:20:53.916666 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-31506fd4-fbd0-4d7a-aa82-cdea77e9c2fb tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:53.924764 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-31506fd4-fbd0-4d7a-aa82-cdea77e9c2fb tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:53.925330 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-31506fd4-fbd0-4d7a-aa82-cdea77e9c2fb tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:53.926183 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-31506fd4-fbd0-4d7a-aa82-cdea77e9c2fb tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:53.926675 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-31506fd4-fbd0-4d7a-aa82-cdea77e9c2fb tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:54.083591 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-31506fd4-fbd0-4d7a-aa82-cdea77e9c2fb tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "POST /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b/action" status: 202 len: 0 microversion: 2.1 time: 0.171923 Apr 14 16:20:54.084267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 592/1179] 10.222.0.60 () {60 vars in 1268 bytes} [Wed Apr 14 16:20:53 2021] POST /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:20:54.093701 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b733eb3e-3337-4190-8059-4df5c8a07829 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:54.094370 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b733eb3e-3337-4190-8059-4df5c8a07829 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:54.102440 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b733eb3e-3337-4190-8059-4df5c8a07829 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:54.103214 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b733eb3e-3337-4190-8059-4df5c8a07829 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:54.104239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b733eb3e-3337-4190-8059-4df5c8a07829 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:54.104965 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b733eb3e-3337-4190-8059-4df5c8a07829 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:54.509029 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b733eb3e-3337-4190-8059-4df5c8a07829 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:54.520465 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b733eb3e-3337-4190-8059-4df5c8a07829 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1515 microversion: 2.1 time: 0.430705 Apr 14 16:20:54.521269 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 588/1180] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:54 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1515 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:55.541691 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7a8b77b6-abba-42a8-8c20-cbcad511da79 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:55.542412 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7a8b77b6-abba-42a8-8c20-cbcad511da79 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:55.550286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7a8b77b6-abba-42a8-8c20-cbcad511da79 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:55.550796 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7a8b77b6-abba-42a8-8c20-cbcad511da79 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:55.551633 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7a8b77b6-abba-42a8-8c20-cbcad511da79 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:55.552130 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7a8b77b6-abba-42a8-8c20-cbcad511da79 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:55.745515 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7a8b77b6-abba-42a8-8c20-cbcad511da79 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:55.754307 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7a8b77b6-abba-42a8-8c20-cbcad511da79 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1517 microversion: 2.1 time: 0.217870 Apr 14 16:20:55.754938 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 593/1181] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:55 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1517 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:56.772868 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f8649c90-795e-4203-91ba-f47c77a77533 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:56.773639 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-f8649c90-795e-4203-91ba-f47c77a77533 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:56.781881 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f8649c90-795e-4203-91ba-f47c77a77533 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:56.782383 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f8649c90-795e-4203-91ba-f47c77a77533 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:56.783206 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f8649c90-795e-4203-91ba-f47c77a77533 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:56.783698 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-f8649c90-795e-4203-91ba-f47c77a77533 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:56.980051 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-f8649c90-795e-4203-91ba-f47c77a77533 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:56.989170 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f8649c90-795e-4203-91ba-f47c77a77533 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1517 microversion: 2.1 time: 0.220323 Apr 14 16:20:56.989802 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 589/1182] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:56 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1517 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:58.007075 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-51d0efe0-69d1-4823-b8f6-b34e09ca53c3 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:58.007770 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-51d0efe0-69d1-4823-b8f6-b34e09ca53c3 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:58.015534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-51d0efe0-69d1-4823-b8f6-b34e09ca53c3 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:58.016034 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-51d0efe0-69d1-4823-b8f6-b34e09ca53c3 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:58.016856 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-51d0efe0-69d1-4823-b8f6-b34e09ca53c3 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:58.017367 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-51d0efe0-69d1-4823-b8f6-b34e09ca53c3 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:58.214330 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-51d0efe0-69d1-4823-b8f6-b34e09ca53c3 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:58.223078 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-51d0efe0-69d1-4823-b8f6-b34e09ca53c3 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1517 microversion: 2.1 time: 0.220082 Apr 14 16:20:58.223699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 594/1183] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:58 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1517 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:59.243520 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ac641285-ce76-454b-b6a6-529eeac895e4 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:20:59.244191 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ac641285-ce76-454b-b6a6-529eeac895e4 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:20:59.252438 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ac641285-ce76-454b-b6a6-529eeac895e4 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:59.253496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ac641285-ce76-454b-b6a6-529eeac895e4 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:59.254342 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ac641285-ce76-454b-b6a6-529eeac895e4 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:20:59.255037 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ac641285-ce76-454b-b6a6-529eeac895e4 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:20:59.508405 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ac641285-ce76-454b-b6a6-529eeac895e4 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:20:59.517989 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ac641285-ce76-454b-b6a6-529eeac895e4 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1517 microversion: 2.1 time: 0.278978 Apr 14 16:20:59.518102 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 590/1184] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:20:59 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1517 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:00.536454 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4aa194b4-a7fc-45f2-b820-3af9dd7834ab tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:00.537267 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4aa194b4-a7fc-45f2-b820-3af9dd7834ab tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:00.546074 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4aa194b4-a7fc-45f2-b820-3af9dd7834ab tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:00.546879 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4aa194b4-a7fc-45f2-b820-3af9dd7834ab tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:00.547355 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4aa194b4-a7fc-45f2-b820-3af9dd7834ab tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:00.547839 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4aa194b4-a7fc-45f2-b820-3af9dd7834ab tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:00.837198 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4aa194b4-a7fc-45f2-b820-3af9dd7834ab tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:00.846770 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4aa194b4-a7fc-45f2-b820-3af9dd7834ab tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1517 microversion: 2.1 time: 0.314418 Apr 14 16:21:00.850147 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 595/1185] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:00 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1517 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:01.866219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d2000cdf-d956-4174-b414-d36304e4029a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:01.868081 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d2000cdf-d956-4174-b414-d36304e4029a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:01.875907 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d2000cdf-d956-4174-b414-d36304e4029a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:01.876416 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d2000cdf-d956-4174-b414-d36304e4029a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:01.877290 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d2000cdf-d956-4174-b414-d36304e4029a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:01.877775 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d2000cdf-d956-4174-b414-d36304e4029a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:02.083800 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d2000cdf-d956-4174-b414-d36304e4029a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:02.093362 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d2000cdf-d956-4174-b414-d36304e4029a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1573 microversion: 2.1 time: 0.231204 Apr 14 16:21:02.094005 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 591/1186] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:01 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1573 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:03.112083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-49fc0d7e-eb6b-4cf8-a479-899a15d5a80a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:03.112837 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-49fc0d7e-eb6b-4cf8-a479-899a15d5a80a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:03.121357 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49fc0d7e-eb6b-4cf8-a479-899a15d5a80a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:03.121865 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49fc0d7e-eb6b-4cf8-a479-899a15d5a80a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:03.122698 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49fc0d7e-eb6b-4cf8-a479-899a15d5a80a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:03.123199 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-49fc0d7e-eb6b-4cf8-a479-899a15d5a80a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:03.326140 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-49fc0d7e-eb6b-4cf8-a479-899a15d5a80a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:03.335459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-49fc0d7e-eb6b-4cf8-a479-899a15d5a80a tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1573 microversion: 2.1 time: 0.227111 Apr 14 16:21:03.335695 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 596/1187] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:03 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1573 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:04.354628 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2091b759-55af-46f1-94f1-6166d7e49d36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:04.355906 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2091b759-55af-46f1-94f1-6166d7e49d36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:04.364824 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2091b759-55af-46f1-94f1-6166d7e49d36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:04.365389 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2091b759-55af-46f1-94f1-6166d7e49d36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:04.366249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2091b759-55af-46f1-94f1-6166d7e49d36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:04.367480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2091b759-55af-46f1-94f1-6166d7e49d36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:04.564564 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2091b759-55af-46f1-94f1-6166d7e49d36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:04.573782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2091b759-55af-46f1-94f1-6166d7e49d36 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1573 microversion: 2.1 time: 0.224063 Apr 14 16:21:04.574413 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 592/1188] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:04 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1573 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:05.592297 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-dd773e18-c9cd-4a65-ab77-b186090c4798 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:05.593059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-dd773e18-c9cd-4a65-ab77-b186090c4798 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:05.602055 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dd773e18-c9cd-4a65-ab77-b186090c4798 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:05.602754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dd773e18-c9cd-4a65-ab77-b186090c4798 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:05.603974 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dd773e18-c9cd-4a65-ab77-b186090c4798 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:05.604424 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dd773e18-c9cd-4a65-ab77-b186090c4798 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:05.805598 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-dd773e18-c9cd-4a65-ab77-b186090c4798 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:05.814571 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-dd773e18-c9cd-4a65-ab77-b186090c4798 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1573 microversion: 2.1 time: 0.226594 Apr 14 16:21:05.815206 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 597/1189] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:05 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1573 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:06.833152 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b821d967-ef30-4dbb-b512-f24b267eda0e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:06.833762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b821d967-ef30-4dbb-b512-f24b267eda0e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:06.842813 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b821d967-ef30-4dbb-b512-f24b267eda0e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:06.843322 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b821d967-ef30-4dbb-b512-f24b267eda0e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:06.844157 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b821d967-ef30-4dbb-b512-f24b267eda0e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:06.844646 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b821d967-ef30-4dbb-b512-f24b267eda0e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:07.057739 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b821d967-ef30-4dbb-b512-f24b267eda0e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:07.067004 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b821d967-ef30-4dbb-b512-f24b267eda0e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1573 microversion: 2.1 time: 0.238010 Apr 14 16:21:07.067634 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 593/1190] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:06 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1573 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:08.086574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-69a73ec6-6e3d-45bf-9f29-cb926ee4754b tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:08.087796 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-69a73ec6-6e3d-45bf-9f29-cb926ee4754b tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:08.095782 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-69a73ec6-6e3d-45bf-9f29-cb926ee4754b tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:08.096510 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-69a73ec6-6e3d-45bf-9f29-cb926ee4754b tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:08.097558 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-69a73ec6-6e3d-45bf-9f29-cb926ee4754b tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:08.098503 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-69a73ec6-6e3d-45bf-9f29-cb926ee4754b tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:08.306117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-69a73ec6-6e3d-45bf-9f29-cb926ee4754b tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:08.315072 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-69a73ec6-6e3d-45bf-9f29-cb926ee4754b tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1573 microversion: 2.1 time: 0.233296 Apr 14 16:21:08.315698 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 598/1191] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:08 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1573 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:09.335534 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-236ddd98-85af-4b81-b170-02ee8412ec96 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:09.336189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-236ddd98-85af-4b81-b170-02ee8412ec96 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:09.344233 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-236ddd98-85af-4b81-b170-02ee8412ec96 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:09.344951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-236ddd98-85af-4b81-b170-02ee8412ec96 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:09.345796 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-236ddd98-85af-4b81-b170-02ee8412ec96 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:09.346286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-236ddd98-85af-4b81-b170-02ee8412ec96 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:09.570639 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-236ddd98-85af-4b81-b170-02ee8412ec96 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:09.579662 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-236ddd98-85af-4b81-b170-02ee8412ec96 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1573 microversion: 2.1 time: 0.249208 Apr 14 16:21:09.580308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 594/1192] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:09 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1573 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:10.598716 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3b5d48b5-aa00-4879-b470-c53cb67c3926 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:10.599402 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3b5d48b5-aa00-4879-b470-c53cb67c3926 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:10.608348 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3b5d48b5-aa00-4879-b470-c53cb67c3926 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:10.608846 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3b5d48b5-aa00-4879-b470-c53cb67c3926 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:10.609742 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3b5d48b5-aa00-4879-b470-c53cb67c3926 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:10.610227 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3b5d48b5-aa00-4879-b470-c53cb67c3926 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:10.808410 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3b5d48b5-aa00-4879-b470-c53cb67c3926 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:10.817749 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3b5d48b5-aa00-4879-b470-c53cb67c3926 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1573 microversion: 2.1 time: 0.223201 Apr 14 16:21:10.818380 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 599/1193] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:10 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1573 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:11.835769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-67ed6de6-75f4-427a-a607-6a8cce658b2e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:11.836428 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-67ed6de6-75f4-427a-a607-6a8cce658b2e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:11.844358 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-67ed6de6-75f4-427a-a607-6a8cce658b2e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:11.844862 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-67ed6de6-75f4-427a-a607-6a8cce658b2e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:11.845715 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-67ed6de6-75f4-427a-a607-6a8cce658b2e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:11.846200 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-67ed6de6-75f4-427a-a607-6a8cce658b2e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:12.040104 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-67ed6de6-75f4-427a-a607-6a8cce658b2e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:12.048860 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-67ed6de6-75f4-427a-a607-6a8cce658b2e tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1573 microversion: 2.1 time: 0.217251 Apr 14 16:21:12.049514 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 595/1194] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:11 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1573 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:13.067647 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8662f1fb-f5d1-4d37-840a-d806c88ab327 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:13.068317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8662f1fb-f5d1-4d37-840a-d806c88ab327 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:13.076709 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8662f1fb-f5d1-4d37-840a-d806c88ab327 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:13.077257 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8662f1fb-f5d1-4d37-840a-d806c88ab327 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:13.078089 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8662f1fb-f5d1-4d37-840a-d806c88ab327 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:13.078576 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8662f1fb-f5d1-4d37-840a-d806c88ab327 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:13.284962 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8662f1fb-f5d1-4d37-840a-d806c88ab327 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:13.294504 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8662f1fb-f5d1-4d37-840a-d806c88ab327 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1573 microversion: 2.1 time: 0.230936 Apr 14 16:21:13.295133 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 600/1195] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:13 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1573 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:14.312333 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0449e89c-4ce7-40c8-b09c-52cfdf3aab8f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:14.313132 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0449e89c-4ce7-40c8-b09c-52cfdf3aab8f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:14.321974 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0449e89c-4ce7-40c8-b09c-52cfdf3aab8f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:14.322480 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0449e89c-4ce7-40c8-b09c-52cfdf3aab8f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:14.323319 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0449e89c-4ce7-40c8-b09c-52cfdf3aab8f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:14.323888 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0449e89c-4ce7-40c8-b09c-52cfdf3aab8f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:14.538868 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0449e89c-4ce7-40c8-b09c-52cfdf3aab8f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:14.547935 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0449e89c-4ce7-40c8-b09c-52cfdf3aab8f tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1573 microversion: 2.1 time: 0.239999 Apr 14 16:21:14.548663 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 596/1196] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:14 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1573 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:14.923736 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-8e739c2e-4bd6-4751-bbcf-9fcdea3caf87 req-fd6e87b3-07e4-4e7a-b98a-805cbddbace0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec37842c-337c-481a-b350-8055f911d09b", "name": "network-vif-plugged", "status": "completed", "tag": "eb2c22c1-6bf1-4f7d-b0f0-ca1c076c35be"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:21:14.925786 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:21:14.925786 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:21:14.937288 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-8e739c2e-4bd6-4751-bbcf-9fcdea3caf87 req-fd6e87b3-07e4-4e7a-b98a-805cbddbace0 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:14.937981 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-8e739c2e-4bd6-4751-bbcf-9fcdea3caf87 req-fd6e87b3-07e4-4e7a-b98a-805cbddbace0 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:14.961019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-8e739c2e-4bd6-4751-bbcf-9fcdea3caf87 req-fd6e87b3-07e4-4e7a-b98a-805cbddbace0 service nova] Creating event network-vif-plugged:eb2c22c1-6bf1-4f7d-b0f0-ca1c076c35be for instance ec37842c-337c-481a-b350-8055f911d09b on hv-cinder-78626 Apr 14 16:21:14.966424 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-8e739c2e-4bd6-4751-bbcf-9fcdea3caf87 req-fd6e87b3-07e4-4e7a-b98a-805cbddbace0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046586 Apr 14 16:21:14.967247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 601/1197] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:21:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:21:15.566882 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8f01f97b-3062-41c0-a832-d86a4208c8bc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:15.567576 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8f01f97b-3062-41c0-a832-d86a4208c8bc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:15.575859 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f01f97b-3062-41c0-a832-d86a4208c8bc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:15.576361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f01f97b-3062-41c0-a832-d86a4208c8bc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:15.577209 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f01f97b-3062-41c0-a832-d86a4208c8bc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:15.577692 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-8f01f97b-3062-41c0-a832-d86a4208c8bc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:15.774867 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8f01f97b-3062-41c0-a832-d86a4208c8bc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:15.783932 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8f01f97b-3062-41c0-a832-d86a4208c8bc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1573 microversion: 2.1 time: 0.221218 Apr 14 16:21:15.784558 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 597/1198] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:15 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1573 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:16.803253 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-76a0fdad-522d-4d2d-9f9c-3c4279893efc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:16.804052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-76a0fdad-522d-4d2d-9f9c-3c4279893efc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:16.812073 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-76a0fdad-522d-4d2d-9f9c-3c4279893efc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:16.812576 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-76a0fdad-522d-4d2d-9f9c-3c4279893efc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:16.813472 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-76a0fdad-522d-4d2d-9f9c-3c4279893efc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:16.813960 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-76a0fdad-522d-4d2d-9f9c-3c4279893efc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:17.006964 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-76a0fdad-522d-4d2d-9f9c-3c4279893efc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:17.015966 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-76a0fdad-522d-4d2d-9f9c-3c4279893efc tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1560 microversion: 2.1 time: 0.217462 Apr 14 16:21:17.016592 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 602/1199] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:16 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:27.699444 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1419494736", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452", "networks": [{"uuid": "ebb2bd65-b40d-40a6-9312-374b615ea71c"}]}} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:21:27.779609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] validate_networks() for [('ebb2bd65-b40d-40a6-9312-374b615ea71c', None, None, None)] {{(pid=99334) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:21:28.321435 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Flavor limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:21:28.321921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Image limits 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:21:28.322466 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Flavor pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:21:28.322931 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Image pref 0:0:0 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:21:28.323397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:21:28.332572 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:28.333098 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:28.334102 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:28.334688 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:28.353676 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Getting quotas for project 28bab49fdf1d4cd6ad3fd130ccdcb79d. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:21:28.358026 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Getting quotas for user 442e093ebb8c438390b568dc319865eb and project 28bab49fdf1d4cd6ad3fd130ccdcb79d. Resources: {'cores', 'instances', 'ram'} {{(pid=99334) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:21:28.369970 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Going to run 1 instances... {{(pid=99334) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:21:28.372523 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:21:28.424174 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6d192abe-9ab0-4e6b-9aec-374ab1cc5f10 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728703 Apr 14 16:21:28.424852 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 598/1200] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:21:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:21:28.436327 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-8e29f202-9532-4d51-9824-c30951632b31 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:28.437001 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-8e29f202-9532-4d51-9824-c30951632b31 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:28.519216 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-8e29f202-9532-4d51-9824-c30951632b31 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:28.527243 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-8e29f202-9532-4d51-9824-c30951632b31 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1214 microversion: 2.1 time: 0.095224 Apr 14 16:21:28.527877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 603/1201] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:28 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:29.546795 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-06b93b91-0ed0-43db-8aa3-f1283e49b4bc tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:29.547390 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-06b93b91-0ed0-43db-8aa3-f1283e49b4bc tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:29.556529 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06b93b91-0ed0-43db-8aa3-f1283e49b4bc tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:29.557028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06b93b91-0ed0-43db-8aa3-f1283e49b4bc tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:29.557877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06b93b91-0ed0-43db-8aa3-f1283e49b4bc tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:29.558359 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-06b93b91-0ed0-43db-8aa3-f1283e49b4bc tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:29.687686 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-06b93b91-0ed0-43db-8aa3-f1283e49b4bc tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:29.697221 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-06b93b91-0ed0-43db-8aa3-f1283e49b4bc tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1266 microversion: 2.1 time: 0.154853 Apr 14 16:21:29.697849 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 599/1202] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:29 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:30.716150 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-23c360e7-2914-4566-8cd1-efa02287c9ad tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:30.717459 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-23c360e7-2914-4566-8cd1-efa02287c9ad tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:30.726191 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23c360e7-2914-4566-8cd1-efa02287c9ad tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:30.726712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23c360e7-2914-4566-8cd1-efa02287c9ad tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:30.727566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23c360e7-2914-4566-8cd1-efa02287c9ad tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:30.728067 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-23c360e7-2914-4566-8cd1-efa02287c9ad tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:30.967014 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-23c360e7-2914-4566-8cd1-efa02287c9ad tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:30.977154 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-23c360e7-2914-4566-8cd1-efa02287c9ad tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1314 microversion: 2.1 time: 0.265127 Apr 14 16:21:30.979137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 604/1203] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:30 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:31.997412 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-75f90ef2-498e-45e6-889a-92a4889a2aa5 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:31.998179 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-75f90ef2-498e-45e6-889a-92a4889a2aa5 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:32.006071 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-75f90ef2-498e-45e6-889a-92a4889a2aa5 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:32.006574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-75f90ef2-498e-45e6-889a-92a4889a2aa5 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:32.007405 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-75f90ef2-498e-45e6-889a-92a4889a2aa5 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:32.007889 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-75f90ef2-498e-45e6-889a-92a4889a2aa5 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:32.469637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-75f90ef2-498e-45e6-889a-92a4889a2aa5 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:32.481524 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-75f90ef2-498e-45e6-889a-92a4889a2aa5 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1314 microversion: 2.1 time: 0.488068 Apr 14 16:21:32.487926 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 600/1204] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:31 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:32.626298 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-17d483e2-f979-4c3a-b322-cd8e7ecaaf29 req-0f1eb9fd-d764-4950-b2db-eb447a562f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7", "tag": "fb4ca8c7-d5a3-4e79-9eff-377aa7f7695d"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:21:32.628083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:21:32.628083 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:21:32.637150 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-17d483e2-f979-4c3a-b322-cd8e7ecaaf29 req-0f1eb9fd-d764-4950-b2db-eb447a562f33 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:32.637790 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-17d483e2-f979-4c3a-b322-cd8e7ecaaf29 req-0f1eb9fd-d764-4950-b2db-eb447a562f33 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:32.656347 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-17d483e2-f979-4c3a-b322-cd8e7ecaaf29 req-0f1eb9fd-d764-4950-b2db-eb447a562f33 service nova] Creating event network-changed:fb4ca8c7-d5a3-4e79-9eff-377aa7f7695d for instance 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 on hv-cinder-78626 Apr 14 16:21:32.661580 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-17d483e2-f979-4c3a-b322-cd8e7ecaaf29 req-0f1eb9fd-d764-4950-b2db-eb447a562f33 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182887 Apr 14 16:21:32.663229 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 605/1205] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:21:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:21:33.500372 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2f6e0748-a859-4f63-b80a-d140f783d113 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:33.501689 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2f6e0748-a859-4f63-b80a-d140f783d113 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:33.510429 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2f6e0748-a859-4f63-b80a-d140f783d113 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:33.511137 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2f6e0748-a859-4f63-b80a-d140f783d113 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:33.512140 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2f6e0748-a859-4f63-b80a-d140f783d113 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:33.512789 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2f6e0748-a859-4f63-b80a-d140f783d113 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:33.833321 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2f6e0748-a859-4f63-b80a-d140f783d113 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:33.842967 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2f6e0748-a859-4f63-b80a-d140f783d113 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1314 microversion: 2.1 time: 0.346536 Apr 14 16:21:33.843586 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 601/1206] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:33 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:34.861754 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c210944a-bed5-47f4-80fe-b47bbff3747f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:34.862661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c210944a-bed5-47f4-80fe-b47bbff3747f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:34.870885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c210944a-bed5-47f4-80fe-b47bbff3747f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:34.871395 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c210944a-bed5-47f4-80fe-b47bbff3747f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:34.872234 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c210944a-bed5-47f4-80fe-b47bbff3747f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:34.872726 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c210944a-bed5-47f4-80fe-b47bbff3747f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:35.077482 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c210944a-bed5-47f4-80fe-b47bbff3747f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:35.087007 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c210944a-bed5-47f4-80fe-b47bbff3747f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1314 microversion: 2.1 time: 0.229887 Apr 14 16:21:35.087648 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 606/1207] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:34 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:36.105870 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0cfe3fc2-f118-49a3-939e-5b9e013685c3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:36.106649 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0cfe3fc2-f118-49a3-939e-5b9e013685c3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:36.115945 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0cfe3fc2-f118-49a3-939e-5b9e013685c3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:36.116530 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0cfe3fc2-f118-49a3-939e-5b9e013685c3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:36.117755 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0cfe3fc2-f118-49a3-939e-5b9e013685c3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:36.118147 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0cfe3fc2-f118-49a3-939e-5b9e013685c3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:36.324453 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0cfe3fc2-f118-49a3-939e-5b9e013685c3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:36.333175 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0cfe3fc2-f118-49a3-939e-5b9e013685c3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1314 microversion: 2.1 time: 0.231378 Apr 14 16:21:36.334562 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 602/1208] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:36 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:37.352601 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-22eecf2e-f2a4-40ee-baa1-cbb40e50c88d tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:37.353308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-22eecf2e-f2a4-40ee-baa1-cbb40e50c88d tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:37.361321 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-22eecf2e-f2a4-40ee-baa1-cbb40e50c88d tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:37.361834 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-22eecf2e-f2a4-40ee-baa1-cbb40e50c88d tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:37.362669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-22eecf2e-f2a4-40ee-baa1-cbb40e50c88d tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:37.363163 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-22eecf2e-f2a4-40ee-baa1-cbb40e50c88d tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:37.565433 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-22eecf2e-f2a4-40ee-baa1-cbb40e50c88d tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:37.574626 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-22eecf2e-f2a4-40ee-baa1-cbb40e50c88d tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1314 microversion: 2.1 time: 0.226781 Apr 14 16:21:37.575266 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 607/1209] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:37 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:38.592505 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e3651f55-cd11-499d-b5a4-df535ee8543f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:38.593214 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e3651f55-cd11-499d-b5a4-df535ee8543f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:38.601254 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e3651f55-cd11-499d-b5a4-df535ee8543f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:38.601757 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e3651f55-cd11-499d-b5a4-df535ee8543f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:38.602587 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e3651f55-cd11-499d-b5a4-df535ee8543f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:38.603068 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e3651f55-cd11-499d-b5a4-df535ee8543f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:38.807730 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e3651f55-cd11-499d-b5a4-df535ee8543f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:38.816790 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e3651f55-cd11-499d-b5a4-df535ee8543f tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1314 microversion: 2.1 time: 0.228168 Apr 14 16:21:38.817457 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 603/1210] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:38 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:39.007646 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-8167f07e-580e-44b5-a18e-129e628a6bfa req-9dc39923-52ea-4e9a-ab0e-8b568f7dfc3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7", "name": "network-vif-plugged", "status": "completed", "tag": "fb4ca8c7-d5a3-4e79-9eff-377aa7f7695d"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:21:39.008962 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:21:39.008962 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:21:39.018172 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-8167f07e-580e-44b5-a18e-129e628a6bfa req-9dc39923-52ea-4e9a-ab0e-8b568f7dfc3c service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:39.018678 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-8167f07e-580e-44b5-a18e-129e628a6bfa req-9dc39923-52ea-4e9a-ab0e-8b568f7dfc3c service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:39.038717 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-8167f07e-580e-44b5-a18e-129e628a6bfa req-9dc39923-52ea-4e9a-ab0e-8b568f7dfc3c service nova] Creating event network-vif-plugged:fb4ca8c7-d5a3-4e79-9eff-377aa7f7695d for instance 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 on hv-cinder-78626 Apr 14 16:21:39.043951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-8167f07e-580e-44b5-a18e-129e628a6bfa req-9dc39923-52ea-4e9a-ab0e-8b568f7dfc3c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041590 Apr 14 16:21:39.044918 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 608/1211] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:21:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:21:39.835996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-857bb7e4-07ef-49b7-b258-5e5d76deeae6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:39.836767 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-857bb7e4-07ef-49b7-b258-5e5d76deeae6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:39.844618 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-857bb7e4-07ef-49b7-b258-5e5d76deeae6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:39.845170 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-857bb7e4-07ef-49b7-b258-5e5d76deeae6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:39.846011 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-857bb7e4-07ef-49b7-b258-5e5d76deeae6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:39.846532 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-857bb7e4-07ef-49b7-b258-5e5d76deeae6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:40.050622 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-857bb7e4-07ef-49b7-b258-5e5d76deeae6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:40.060072 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-857bb7e4-07ef-49b7-b258-5e5d76deeae6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1314 microversion: 2.1 time: 0.228717 Apr 14 16:21:40.060703 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 604/1212] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:39 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:41.079432 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-44c9ed59-bf60-43cb-b614-7b29749c4e03 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:41.080215 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-44c9ed59-bf60-43cb-b614-7b29749c4e03 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:41.089098 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44c9ed59-bf60-43cb-b614-7b29749c4e03 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:41.089604 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44c9ed59-bf60-43cb-b614-7b29749c4e03 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:41.090453 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44c9ed59-bf60-43cb-b614-7b29749c4e03 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:41.090951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-44c9ed59-bf60-43cb-b614-7b29749c4e03 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:41.289902 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-44c9ed59-bf60-43cb-b614-7b29749c4e03 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:41.298706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-44c9ed59-bf60-43cb-b614-7b29749c4e03 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1498 microversion: 2.1 time: 0.223878 Apr 14 16:21:41.299347 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 609/1213] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:41 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1498 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:42.112255 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ad28f02b-074e-47f5-ac77-06d2974e502b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:42.113025 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ad28f02b-074e-47f5-ac77-06d2974e502b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:42.122116 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ad28f02b-074e-47f5-ac77-06d2974e502b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:42.122764 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ad28f02b-074e-47f5-ac77-06d2974e502b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:42.123625 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ad28f02b-074e-47f5-ac77-06d2974e502b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:42.124310 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ad28f02b-074e-47f5-ac77-06d2974e502b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:42.190835 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ad28f02b-074e-47f5-ac77-06d2974e502b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Going to try to terminate instance {{(pid=99334) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:21:42.308219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ad28f02b-074e-47f5-ac77-06d2974e502b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 204 len: 0 microversion: 2.1 time: 0.200170 Apr 14 16:21:42.308853 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 605/1214] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:21:42 2021] DELETE /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:21:42.317728 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-17c8c4c6-cf31-4608-bd82-8e8a492d6f79 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:42.318728 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-17c8c4c6-cf31-4608-bd82-8e8a492d6f79 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:42.326825 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-17c8c4c6-cf31-4608-bd82-8e8a492d6f79 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:42.327342 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-17c8c4c6-cf31-4608-bd82-8e8a492d6f79 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:42.328193 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-17c8c4c6-cf31-4608-bd82-8e8a492d6f79 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:42.328691 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-17c8c4c6-cf31-4608-bd82-8e8a492d6f79 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:42.738171 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-17c8c4c6-cf31-4608-bd82-8e8a492d6f79 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:42.747025 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-17c8c4c6-cf31-4608-bd82-8e8a492d6f79 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1504 microversion: 2.1 time: 0.433449 Apr 14 16:21:42.747653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 610/1215] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:42 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:43.767076 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b406e673-ce7a-4568-a967-85edd945a6a7 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:43.767849 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b406e673-ce7a-4568-a967-85edd945a6a7 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:43.776208 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b406e673-ce7a-4568-a967-85edd945a6a7 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:43.776710 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b406e673-ce7a-4568-a967-85edd945a6a7 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:43.777563 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b406e673-ce7a-4568-a967-85edd945a6a7 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:43.778051 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b406e673-ce7a-4568-a967-85edd945a6a7 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:43.973322 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b406e673-ce7a-4568-a967-85edd945a6a7 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:43.983135 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b406e673-ce7a-4568-a967-85edd945a6a7 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1504 microversion: 2.1 time: 0.220598 Apr 14 16:21:43.983761 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 606/1216] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:43 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:45.001066 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-77987082-db22-44c7-b114-ec9d705d8ec1 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:45.001760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-77987082-db22-44c7-b114-ec9d705d8ec1 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:45.009563 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-77987082-db22-44c7-b114-ec9d705d8ec1 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:45.010059 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-77987082-db22-44c7-b114-ec9d705d8ec1 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:45.010885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-77987082-db22-44c7-b114-ec9d705d8ec1 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:45.011370 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-77987082-db22-44c7-b114-ec9d705d8ec1 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:45.209936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-77987082-db22-44c7-b114-ec9d705d8ec1 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:45.219021 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-77987082-db22-44c7-b114-ec9d705d8ec1 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1504 microversion: 2.1 time: 0.222038 Apr 14 16:21:45.219661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 611/1217] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:44 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:46.237906 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4afb5bcd-91df-4032-a24a-29589e8ebc4b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:46.238574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4afb5bcd-91df-4032-a24a-29589e8ebc4b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:46.246946 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4afb5bcd-91df-4032-a24a-29589e8ebc4b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:46.247451 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4afb5bcd-91df-4032-a24a-29589e8ebc4b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:46.248278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4afb5bcd-91df-4032-a24a-29589e8ebc4b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:46.248762 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-4afb5bcd-91df-4032-a24a-29589e8ebc4b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:46.454109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4afb5bcd-91df-4032-a24a-29589e8ebc4b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:46.463017 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4afb5bcd-91df-4032-a24a-29589e8ebc4b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1504 microversion: 2.1 time: 0.229221 Apr 14 16:21:46.463637 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 607/1218] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:46 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:47.481287 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fc3df21e-5780-4618-b470-a6f6e52ccaa8 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:47.481971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fc3df21e-5780-4618-b470-a6f6e52ccaa8 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:47.490533 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fc3df21e-5780-4618-b470-a6f6e52ccaa8 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:47.491049 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fc3df21e-5780-4618-b470-a6f6e52ccaa8 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:47.491893 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fc3df21e-5780-4618-b470-a6f6e52ccaa8 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:47.492549 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fc3df21e-5780-4618-b470-a6f6e52ccaa8 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:47.690449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-fc3df21e-5780-4618-b470-a6f6e52ccaa8 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:47.699339 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fc3df21e-5780-4618-b470-a6f6e52ccaa8 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1504 microversion: 2.1 time: 0.222099 Apr 14 16:21:47.699977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 612/1219] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:47 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:48.717680 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-7b5a7d5b-8418-4176-885a-9b5bed829cd4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:48.718340 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-7b5a7d5b-8418-4176-885a-9b5bed829cd4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:48.726987 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7b5a7d5b-8418-4176-885a-9b5bed829cd4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:48.727483 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7b5a7d5b-8418-4176-885a-9b5bed829cd4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:48.728303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7b5a7d5b-8418-4176-885a-9b5bed829cd4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:48.728788 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-7b5a7d5b-8418-4176-885a-9b5bed829cd4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:49.070774 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-7b5a7d5b-8418-4176-885a-9b5bed829cd4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:49.079413 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-7b5a7d5b-8418-4176-885a-9b5bed829cd4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1504 microversion: 2.1 time: 0.365683 Apr 14 16:21:49.080042 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 608/1220] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:48 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1504 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:50.098308 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-15cb76c7-1764-488e-8333-11b79f60c821 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:50.100099 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-15cb76c7-1764-488e-8333-11b79f60c821 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:50.107988 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-15cb76c7-1764-488e-8333-11b79f60c821 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:50.108498 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-15cb76c7-1764-488e-8333-11b79f60c821 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:50.109368 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-15cb76c7-1764-488e-8333-11b79f60c821 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:50.109909 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-15cb76c7-1764-488e-8333-11b79f60c821 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:50.307914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-15cb76c7-1764-488e-8333-11b79f60c821 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:50.316949 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-15cb76c7-1764-488e-8333-11b79f60c821 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1504 microversion: 2.1 time: 0.222663 Apr 14 16:21:50.317877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 613/1221] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:50 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:51.336328 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0542f888-db51-4dfd-a544-2216bd230404 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:51.336996 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0542f888-db51-4dfd-a544-2216bd230404 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:51.345190 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0542f888-db51-4dfd-a544-2216bd230404 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:51.345684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0542f888-db51-4dfd-a544-2216bd230404 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:51.346526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0542f888-db51-4dfd-a544-2216bd230404 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:51.347010 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0542f888-db51-4dfd-a544-2216bd230404 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:51.786584 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0542f888-db51-4dfd-a544-2216bd230404 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:51.795236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0542f888-db51-4dfd-a544-2216bd230404 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1504 microversion: 2.1 time: 0.463016 Apr 14 16:21:51.795871 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 609/1222] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:51 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1504 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:52.143705 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-f2b9a6d2-fcf9-4050-ba33-efa8411173a6 req-aabafdc9-91c5-4a4b-98ee-136584aedf4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7", "name": "network-vif-deleted", "tag": "fb4ca8c7-d5a3-4e79-9eff-377aa7f7695d"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:21:52.145467 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:21:52.145467 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:21:52.154966 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-f2b9a6d2-fcf9-4050-ba33-efa8411173a6 req-aabafdc9-91c5-4a4b-98ee-136584aedf4b service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:52.155511 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-f2b9a6d2-fcf9-4050-ba33-efa8411173a6 req-aabafdc9-91c5-4a4b-98ee-136584aedf4b service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:52.173763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-f2b9a6d2-fcf9-4050-ba33-efa8411173a6 req-aabafdc9-91c5-4a4b-98ee-136584aedf4b service nova] Creating event network-vif-deleted:fb4ca8c7-d5a3-4e79-9eff-377aa7f7695d for instance 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 on hv-cinder-78626 Apr 14 16:21:52.179519 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-f2b9a6d2-fcf9-4050-ba33-efa8411173a6 req-aabafdc9-91c5-4a4b-98ee-136584aedf4b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040383 Apr 14 16:21:52.180164 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 614/1223] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:21:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:21:52.813781 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-20e547c3-a685-40d7-804a-8dc71ee873a4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:52.814449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-20e547c3-a685-40d7-804a-8dc71ee873a4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:52.822523 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20e547c3-a685-40d7-804a-8dc71ee873a4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:52.823027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20e547c3-a685-40d7-804a-8dc71ee873a4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:52.823864 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20e547c3-a685-40d7-804a-8dc71ee873a4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:52.824353 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-20e547c3-a685-40d7-804a-8dc71ee873a4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:52.970094 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-20e547c3-a685-40d7-804a-8dc71ee873a4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:52.979749 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-20e547c3-a685-40d7-804a-8dc71ee873a4 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1299 microversion: 2.1 time: 0.170003 Apr 14 16:21:52.980380 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 610/1224] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:52 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1299 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:53.999117 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-1d660a8a-5e4c-47a4-acf5-94c47c8e0f6c tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:53.999903 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-1d660a8a-5e4c-47a4-acf5-94c47c8e0f6c tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:54.008197 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d660a8a-5e4c-47a4-acf5-94c47c8e0f6c tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:54.008702 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d660a8a-5e4c-47a4-acf5-94c47c8e0f6c tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:54.009554 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d660a8a-5e4c-47a4-acf5-94c47c8e0f6c tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:54.010046 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-1d660a8a-5e4c-47a4-acf5-94c47c8e0f6c tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:54.137951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-1d660a8a-5e4c-47a4-acf5-94c47c8e0f6c tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:54.147792 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-1d660a8a-5e4c-47a4-acf5-94c47c8e0f6c tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 200 len: 1299 microversion: 2.1 time: 0.153188 Apr 14 16:21:54.148422 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 615/1225] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:53 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 1299 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:21:55.166669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3ec61a55-e082-4656-8559-52890d40e997 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:55.167331 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3ec61a55-e082-4656-8559-52890d40e997 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:55.175372 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3ec61a55-e082-4656-8559-52890d40e997 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:55.175877 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3ec61a55-e082-4656-8559-52890d40e997 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:55.177348 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3ec61a55-e082-4656-8559-52890d40e997 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:55.177971 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3ec61a55-e082-4656-8559-52890d40e997 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:55.239026 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-3ec61a55-e082-4656-8559-52890d40e997 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] HTTP exception thrown: Instance 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 could not be found. Apr 14 16:21:55.240526 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3ec61a55-e082-4656-8559-52890d40e997 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Returning 404 to user: Instance 0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:21:55.241565 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3ec61a55-e082-4656-8559-52890d40e997 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7" status: 404 len: 111 microversion: 2.1 time: 0.078945 Apr 14 16:21:55.242386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 611/1226] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:55 2021] GET /compute/v2.1/servers/0fc6e3fd-5296-4720-a8f6-d3f42b3d82a7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:21:55.359861 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1717453831", "imageRef": "4da692d3-4c6b-4179-a9bb-cb3e1e006df5", "flavorRef": "452", "networks": [{"uuid": "ebb2bd65-b40d-40a6-9312-374b615ea71c"}]}} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:21:55.433681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.network.neutron [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] validate_networks() for [('ebb2bd65-b40d-40a6-9312-374b615ea71c', None, None, None)] {{(pid=99335) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 14 16:21:56.103080 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Flavor limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:21:56.103553 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Image limits 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 14 16:21:56.104116 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Flavor pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:21:56.104574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Image pref 0:0:0 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 14 16:21:56.105047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.virt.hardware [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 14 16:21:56.114505 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:56.115019 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:56.115898 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:56.116394 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:56.135887 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Getting quotas for project 28bab49fdf1d4cd6ad3fd130ccdcb79d. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 14 16:21:56.140223 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.quota [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Getting quotas for user 442e093ebb8c438390b568dc319865eb and project 28bab49fdf1d4cd6ad3fd130ccdcb79d. Resources: {'cores', 'instances', 'ram'} {{(pid=99335) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 14 16:21:56.152987 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Going to run 1 instances... {{(pid=99335) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 14 16:21:56.156048 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4da692d3-4c6b-4179-a9bb-cb3e1e006df5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 14 16:21:56.206776 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6f3fd5d0-9822-4da4-baa0-dfb026250bef tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850987 Apr 14 16:21:56.207496 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 616/1227] 10.222.0.60 () {60 vars in 1137 bytes} [Wed Apr 14 16:21:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 16:21:56.219275 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-4bc25c6a-ed33-4164-be04-4dfe424cce02 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:56.220056 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-4bc25c6a-ed33-4164-be04-4dfe424cce02 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:56.301630 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-4bc25c6a-ed33-4164-be04-4dfe424cce02 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:56.309852 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-4bc25c6a-ed33-4164-be04-4dfe424cce02 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2" status: 200 len: 1214 microversion: 2.1 time: 0.094840 Apr 14 16:21:56.310486 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 612/1228] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:56 2021] GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:21:57.328323 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2ee91f2b-9d08-440b-aa09-8f85765900d3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:57.328956 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2ee91f2b-9d08-440b-aa09-8f85765900d3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:57.338518 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2ee91f2b-9d08-440b-aa09-8f85765900d3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:57.339036 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2ee91f2b-9d08-440b-aa09-8f85765900d3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:57.339885 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2ee91f2b-9d08-440b-aa09-8f85765900d3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:57.340379 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2ee91f2b-9d08-440b-aa09-8f85765900d3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:57.471653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2ee91f2b-9d08-440b-aa09-8f85765900d3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:57.481370 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2ee91f2b-9d08-440b-aa09-8f85765900d3 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2" status: 200 len: 1266 microversion: 2.1 time: 0.157300 Apr 14 16:21:57.487263 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 617/1229] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:57 2021] GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:58.500262 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-45e34048-1b02-4457-891c-299cf1b4b279 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:58.501064 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-45e34048-1b02-4457-891c-299cf1b4b279 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:58.518703 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45e34048-1b02-4457-891c-299cf1b4b279 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:58.519213 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45e34048-1b02-4457-891c-299cf1b4b279 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:58.521573 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45e34048-1b02-4457-891c-299cf1b4b279 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:58.521573 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-45e34048-1b02-4457-891c-299cf1b4b279 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:58.936582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-45e34048-1b02-4457-891c-299cf1b4b279 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:21:58.947047 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-45e34048-1b02-4457-891c-299cf1b4b279 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2" status: 200 len: 1314 microversion: 2.1 time: 0.450930 Apr 14 16:21:58.947679 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 613/1230] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:58 2021] GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:59.863012 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-8fc08d11-544f-4185-800c-724cea16a56f req-a76b6560-0526-4e39-9068-a9bac5cff8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d73b9b2-e71c-4fa1-b501-77cb94ada4a2", "tag": "3e5997c2-23da-438a-a77f-879675e77e95"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:21:59.865667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:21:59.865667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:21:59.874767 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-8fc08d11-544f-4185-800c-724cea16a56f req-a76b6560-0526-4e39-9068-a9bac5cff8c1 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:59.875272 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-8fc08d11-544f-4185-800c-724cea16a56f req-a76b6560-0526-4e39-9068-a9bac5cff8c1 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:59.892837 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-8fc08d11-544f-4185-800c-724cea16a56f req-a76b6560-0526-4e39-9068-a9bac5cff8c1 service nova] Creating event network-changed:3e5997c2-23da-438a-a77f-879675e77e95 for instance 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 on hv-cinder-78626 Apr 14 16:21:59.898283 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-8fc08d11-544f-4185-800c-724cea16a56f req-a76b6560-0526-4e39-9068-a9bac5cff8c1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039304 Apr 14 16:21:59.898942 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 618/1231] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:21:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:21:59.965412 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-dcc39bb8-e330-452c-8cdf-354fdf4a6f6b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:21:59.966082 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-dcc39bb8-e330-452c-8cdf-354fdf4a6f6b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:21:59.974855 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dcc39bb8-e330-452c-8cdf-354fdf4a6f6b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:59.975371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dcc39bb8-e330-452c-8cdf-354fdf4a6f6b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:21:59.976229 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dcc39bb8-e330-452c-8cdf-354fdf4a6f6b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:21:59.976727 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-dcc39bb8-e330-452c-8cdf-354fdf4a6f6b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:00.304088 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-dcc39bb8-e330-452c-8cdf-354fdf4a6f6b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:00.313103 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-dcc39bb8-e330-452c-8cdf-354fdf4a6f6b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2" status: 200 len: 1314 microversion: 2.1 time: 0.351778 Apr 14 16:22:00.313698 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 614/1232] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:21:59 2021] GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:01.332106 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2fd9661e-fe88-4d7a-895f-6df6ae44ad7b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:01.333077 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2fd9661e-fe88-4d7a-895f-6df6ae44ad7b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:01.341418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2fd9661e-fe88-4d7a-895f-6df6ae44ad7b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:01.342050 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2fd9661e-fe88-4d7a-895f-6df6ae44ad7b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:01.343231 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2fd9661e-fe88-4d7a-895f-6df6ae44ad7b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:01.343832 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2fd9661e-fe88-4d7a-895f-6df6ae44ad7b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:01.600945 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-2fd9661e-fe88-4d7a-895f-6df6ae44ad7b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:01.610052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2fd9661e-fe88-4d7a-895f-6df6ae44ad7b tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2" status: 200 len: 1314 microversion: 2.1 time: 0.282562 Apr 14 16:22:01.610951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 619/1233] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:01 2021] GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:02.628708 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-0631f572-18d7-4998-905d-2fc7f5976ed9 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:02.629629 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-0631f572-18d7-4998-905d-2fc7f5976ed9 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:02.637451 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0631f572-18d7-4998-905d-2fc7f5976ed9 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:02.637951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0631f572-18d7-4998-905d-2fc7f5976ed9 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:02.638778 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0631f572-18d7-4998-905d-2fc7f5976ed9 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:02.639264 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-0631f572-18d7-4998-905d-2fc7f5976ed9 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:02.843467 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-0631f572-18d7-4998-905d-2fc7f5976ed9 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:02.852498 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-0631f572-18d7-4998-905d-2fc7f5976ed9 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2" status: 200 len: 1314 microversion: 2.1 time: 0.227847 Apr 14 16:22:02.853130 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 615/1234] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:02 2021] GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:03.870222 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3e5e01ae-a128-44f4-8fa3-00c0c8356124 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:03.870895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3e5e01ae-a128-44f4-8fa3-00c0c8356124 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:03.878744 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e5e01ae-a128-44f4-8fa3-00c0c8356124 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:03.879249 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e5e01ae-a128-44f4-8fa3-00c0c8356124 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:03.880081 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e5e01ae-a128-44f4-8fa3-00c0c8356124 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:03.880576 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e5e01ae-a128-44f4-8fa3-00c0c8356124 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:04.077361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-3e5e01ae-a128-44f4-8fa3-00c0c8356124 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:04.086615 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3e5e01ae-a128-44f4-8fa3-00c0c8356124 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2" status: 200 len: 1314 microversion: 2.1 time: 0.220577 Apr 14 16:22:04.087247 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 620/1235] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:03 2021] GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:04.739025 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-39866057-d785-43f5-9524-aeb639466509 req-f21fa57b-01ad-427c-be0e-815eee0739dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d73b9b2-e71c-4fa1-b501-77cb94ada4a2", "name": "network-vif-plugged", "status": "completed", "tag": "3e5997c2-23da-438a-a77f-879675e77e95"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:22:04.740914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:22:04.740914 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:22:04.750314 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-39866057-d785-43f5-9524-aeb639466509 req-f21fa57b-01ad-427c-be0e-815eee0739dc service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:04.750815 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-39866057-d785-43f5-9524-aeb639466509 req-f21fa57b-01ad-427c-be0e-815eee0739dc service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:04.768173 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-39866057-d785-43f5-9524-aeb639466509 req-f21fa57b-01ad-427c-be0e-815eee0739dc service nova] Creating event network-vif-plugged:3e5997c2-23da-438a-a77f-879675e77e95 for instance 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 on hv-cinder-78626 Apr 14 16:22:04.773388 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-39866057-d785-43f5-9524-aeb639466509 req-f21fa57b-01ad-427c-be0e-815eee0739dc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233857 Apr 14 16:22:04.774020 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 616/1236] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:22:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:22:05.104931 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d9d65d37-d067-49e0-8fd1-7170158871cd tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:05.105635 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d9d65d37-d067-49e0-8fd1-7170158871cd tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:05.113542 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d9d65d37-d067-49e0-8fd1-7170158871cd tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:05.114060 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d9d65d37-d067-49e0-8fd1-7170158871cd tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:05.114880 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d9d65d37-d067-49e0-8fd1-7170158871cd tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:05.115569 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d9d65d37-d067-49e0-8fd1-7170158871cd tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:05.316805 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-d9d65d37-d067-49e0-8fd1-7170158871cd tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:05.325642 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d9d65d37-d067-49e0-8fd1-7170158871cd tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2" status: 200 len: 1314 microversion: 2.1 time: 0.225623 Apr 14 16:22:05.326279 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 621/1237] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:05 2021] GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:06.344868 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-6bb889f0-be98-494f-ae9f-3ef624479e85 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:06.345659 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-6bb889f0-be98-494f-ae9f-3ef624479e85 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:06.354275 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6bb889f0-be98-494f-ae9f-3ef624479e85 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:06.354784 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6bb889f0-be98-494f-ae9f-3ef624479e85 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:06.355615 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6bb889f0-be98-494f-ae9f-3ef624479e85 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:06.356103 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-6bb889f0-be98-494f-ae9f-3ef624479e85 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:06.557488 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-6bb889f0-be98-494f-ae9f-3ef624479e85 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:06.566232 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-6bb889f0-be98-494f-ae9f-3ef624479e85 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2" status: 200 len: 1499 microversion: 2.1 time: 0.225905 Apr 14 16:22:06.566858 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 617/1238] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:06 2021] GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 => generated 1499 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:07.406052 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9a487314-6502-4b58-b760-75cfbeb20e92 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:07.406635 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9a487314-6502-4b58-b760-75cfbeb20e92 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:07.414708 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9a487314-6502-4b58-b760-75cfbeb20e92 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:07.415215 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9a487314-6502-4b58-b760-75cfbeb20e92 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:07.416041 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9a487314-6502-4b58-b760-75cfbeb20e92 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:07.416535 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9a487314-6502-4b58-b760-75cfbeb20e92 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:07.481752 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9a487314-6502-4b58-b760-75cfbeb20e92 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] Going to try to terminate instance {{(pid=99335) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:22:07.594601 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9a487314-6502-4b58-b760-75cfbeb20e92 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2" status: 204 len: 0 microversion: 2.1 time: 0.192491 Apr 14 16:22:07.595242 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 622/1239] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:22:07 2021] DELETE /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:22:07.605095 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-ae9ebeb8-506e-44e7-ba2f-b2d945a840cb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:07.605813 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-ae9ebeb8-506e-44e7-ba2f-b2d945a840cb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:07.613662 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ae9ebeb8-506e-44e7-ba2f-b2d945a840cb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:07.614168 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ae9ebeb8-506e-44e7-ba2f-b2d945a840cb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:07.615011 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ae9ebeb8-506e-44e7-ba2f-b2d945a840cb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:07.615505 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-ae9ebeb8-506e-44e7-ba2f-b2d945a840cb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:07.808894 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-ae9ebeb8-506e-44e7-ba2f-b2d945a840cb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:07.817609 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-ae9ebeb8-506e-44e7-ba2f-b2d945a840cb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2" status: 200 len: 1505 microversion: 2.1 time: 0.217435 Apr 14 16:22:07.818235 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 618/1240] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:07 2021] GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:08.838717 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e4aa492b-312e-4e59-9fbf-1e27dae2b2c6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:08.839490 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e4aa492b-312e-4e59-9fbf-1e27dae2b2c6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:08.847286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e4aa492b-312e-4e59-9fbf-1e27dae2b2c6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:08.847797 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e4aa492b-312e-4e59-9fbf-1e27dae2b2c6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:08.848633 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e4aa492b-312e-4e59-9fbf-1e27dae2b2c6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:08.849150 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e4aa492b-312e-4e59-9fbf-1e27dae2b2c6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:09.051936 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e4aa492b-312e-4e59-9fbf-1e27dae2b2c6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:09.061189 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e4aa492b-312e-4e59-9fbf-1e27dae2b2c6 tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2" status: 200 len: 1505 microversion: 2.1 time: 0.228200 Apr 14 16:22:09.061810 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 623/1241] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:08 2021] GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:10.078836 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e0c9830f-5239-4925-9ad4-1294f4f70ffb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:10.079504 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e0c9830f-5239-4925-9ad4-1294f4f70ffb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:10.088246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e0c9830f-5239-4925-9ad4-1294f4f70ffb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:10.088760 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e0c9830f-5239-4925-9ad4-1294f4f70ffb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:10.089661 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e0c9830f-5239-4925-9ad4-1294f4f70ffb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:10.090157 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e0c9830f-5239-4925-9ad4-1294f4f70ffb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:10.509708 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e0c9830f-5239-4925-9ad4-1294f4f70ffb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442e093ebb8c438390b568dc319865eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bab49fdf1d4cd6ad3fd130ccdcb79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:10.518775 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e0c9830f-5239-4925-9ad4-1294f4f70ffb tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2" status: 200 len: 1505 microversion: 2.1 time: 0.444083 Apr 14 16:22:10.519641 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 619/1242] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:10 2021] GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:10.650666 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-6fddc2b6-edec-4f6c-b28c-2a082c3be669 req-69778208-751a-4acc-822a-518514973415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d73b9b2-e71c-4fa1-b501-77cb94ada4a2", "name": "network-vif-deleted", "tag": "3e5997c2-23da-438a-a77f-879675e77e95"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:22:10.652454 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:22:10.652454 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:22:10.661612 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-6fddc2b6-edec-4f6c-b28c-2a082c3be669 req-69778208-751a-4acc-822a-518514973415 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:10.662116 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-6fddc2b6-edec-4f6c-b28c-2a082c3be669 req-69778208-751a-4acc-822a-518514973415 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:10.682202 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-6fddc2b6-edec-4f6c-b28c-2a082c3be669 req-69778208-751a-4acc-822a-518514973415 service nova] Creating event network-vif-deleted:3e5997c2-23da-438a-a77f-879675e77e95 for instance 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 on hv-cinder-78626 Apr 14 16:22:10.687215 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-6fddc2b6-edec-4f6c-b28c-2a082c3be669 req-69778208-751a-4acc-822a-518514973415 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041716 Apr 14 16:22:10.687873 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 624/1243] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:22:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:22:11.537690 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-961a2220-d8e7-4760-8969-474c9e17facf tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:11.538951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-961a2220-d8e7-4760-8969-474c9e17facf tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] [instance: 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:11.546909 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-961a2220-d8e7-4760-8969-474c9e17facf tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:11.547402 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-961a2220-d8e7-4760-8969-474c9e17facf tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:11.548228 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-961a2220-d8e7-4760-8969-474c9e17facf tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:11.548710 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-961a2220-d8e7-4760-8969-474c9e17facf tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:11.602418 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-961a2220-d8e7-4760-8969-474c9e17facf tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] HTTP exception thrown: Instance 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 could not be found. Apr 14 16:22:11.603075 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-961a2220-d8e7-4760-8969-474c9e17facf tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] Returning 404 to user: Instance 7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:22:11.603966 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-961a2220-d8e7-4760-8969-474c9e17facf tempest-VolumesActionsTest-958926928 tempest-VolumesActionsTest-958926928-project] 10.222.0.60 "GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2" status: 404 len: 111 microversion: 2.1 time: 0.070562 Apr 14 16:22:11.604569 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 620/1244] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:11 2021] GET /compute/v2.1/servers/7d73b9b2-e71c-4fa1-b501-77cb94ada4a2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:22:28.178330 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3e345371-a31c-4ce1-9839-37e570c0c93b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:28.179657 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3e345371-a31c-4ce1-9839-37e570c0c93b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:28.192504 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e345371-a31c-4ce1-9839-37e570c0c93b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:28.193977 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e345371-a31c-4ce1-9839-37e570c0c93b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:28.195072 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e345371-a31c-4ce1-9839-37e570c0c93b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:28.195759 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3e345371-a31c-4ce1-9839-37e570c0c93b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:28.197209 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3f26bc18-578e-4438-b61b-a3339da80633] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 16:22:28.279845 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3e345371-a31c-4ce1-9839-37e570c0c93b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Going to try to terminate instance {{(pid=99335) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:22:28.337097 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-5e38d42a-fc0f-4543-909b-de6fc5846938 req-aca525c2-4c67-400f-b32d-28e54e6c9ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d409a4ad-aebe-4041-bbfc-6b76520d6d02", "tag": "312d4cc5-7239-4df5-b7ed-2b4bf3f5dbbb"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:22:28.340769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:22:28.340769 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:22:28.361814 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-5e38d42a-fc0f-4543-909b-de6fc5846938 req-aca525c2-4c67-400f-b32d-28e54e6c9ada service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:28.362455 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-5e38d42a-fc0f-4543-909b-de6fc5846938 req-aca525c2-4c67-400f-b32d-28e54e6c9ada service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:28.388474 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-5e38d42a-fc0f-4543-909b-de6fc5846938 req-aca525c2-4c67-400f-b32d-28e54e6c9ada service nova] Creating event network-changed:312d4cc5-7239-4df5-b7ed-2b4bf3f5dbbb for instance d409a4ad-aebe-4041-bbfc-6b76520d6d02 on hv-cinder-78626 Apr 14 16:22:28.400076 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-5e38d42a-fc0f-4543-909b-de6fc5846938 req-aca525c2-4c67-400f-b32d-28e54e6c9ada service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208406 Apr 14 16:22:28.400725 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 621/1245] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:22:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:22:28.439192 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3e345371-a31c-4ce1-9839-37e570c0c93b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 204 len: 0 microversion: 2.1 time: 0.265110 Apr 14 16:22:28.440657 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 625/1246] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:22:28 2021] DELETE /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:22:28.455239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9229e7a7-ebb5-46ab-b8a6-9f834261ea0b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:28.456054 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9229e7a7-ebb5-46ab-b8a6-9f834261ea0b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:28.476013 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9229e7a7-ebb5-46ab-b8a6-9f834261ea0b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:28.476529 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9229e7a7-ebb5-46ab-b8a6-9f834261ea0b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:28.484419 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9229e7a7-ebb5-46ab-b8a6-9f834261ea0b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:28.485501 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9229e7a7-ebb5-46ab-b8a6-9f834261ea0b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:29.111501 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9229e7a7-ebb5-46ab-b8a6-9f834261ea0b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:29.134868 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9229e7a7-ebb5-46ab-b8a6-9f834261ea0b tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1576 microversion: 2.1 time: 0.687963 Apr 14 16:22:29.140507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 622/1247] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:28 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1576 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:30.163998 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-af066ecf-5616-4718-b58b-7d62d12948b1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:30.164795 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-af066ecf-5616-4718-b58b-7d62d12948b1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:30.192240 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO oslo.messaging._drivers.impl_rabbit [-] [3f26bc18-578e-4438-b61b-a3339da80633] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 57480. Apr 14 16:22:30.197624 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-af066ecf-5616-4718-b58b-7d62d12948b1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:30.198151 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-af066ecf-5616-4718-b58b-7d62d12948b1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:30.199025 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-af066ecf-5616-4718-b58b-7d62d12948b1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:30.199712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-af066ecf-5616-4718-b58b-7d62d12948b1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:30.343008 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:22:30.343273 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: Wed Apr 14 16:22:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 (ip 10.222.0.60) !!! Apr 14 16:22:30.463180 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-af066ecf-5616-4718-b58b-7d62d12948b1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:30.473883 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-af066ecf-5616-4718-b58b-7d62d12948b1 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1458 microversion: 2.1 time: 0.314596 Apr 14 16:22:30.475872 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 626/1248] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:30 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1458 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:31.494866 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c2e3b027-e1b7-4ac2-b4ee-fff0bc9bcbdb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:31.496104 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c2e3b027-e1b7-4ac2-b4ee-fff0bc9bcbdb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:31.506590 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c2e3b027-e1b7-4ac2-b4ee-fff0bc9bcbdb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:31.507522 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c2e3b027-e1b7-4ac2-b4ee-fff0bc9bcbdb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:31.508943 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c2e3b027-e1b7-4ac2-b4ee-fff0bc9bcbdb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:31.509702 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c2e3b027-e1b7-4ac2-b4ee-fff0bc9bcbdb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:31.883128 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c2e3b027-e1b7-4ac2-b4ee-fff0bc9bcbdb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:31.893426 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c2e3b027-e1b7-4ac2-b4ee-fff0bc9bcbdb tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1458 microversion: 2.1 time: 0.404007 Apr 14 16:22:31.894517 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 623/1249] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:31 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1458 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:32.234704 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-6e9f88fd-558a-4430-8079-457cd92ac6fd req-54a0dbe4-f6c6-4a2a-ac62-725e7a32009c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d409a4ad-aebe-4041-bbfc-6b76520d6d02", "name": "network-vif-deleted", "tag": "312d4cc5-7239-4df5-b7ed-2b4bf3f5dbbb"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:22:32.236393 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:22:32.236393 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:22:32.247147 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-6e9f88fd-558a-4430-8079-457cd92ac6fd req-54a0dbe4-f6c6-4a2a-ac62-725e7a32009c service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:32.247676 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-6e9f88fd-558a-4430-8079-457cd92ac6fd req-54a0dbe4-f6c6-4a2a-ac62-725e7a32009c service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:32.265763 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-6e9f88fd-558a-4430-8079-457cd92ac6fd req-54a0dbe4-f6c6-4a2a-ac62-725e7a32009c service nova] Creating event network-vif-deleted:312d4cc5-7239-4df5-b7ed-2b4bf3f5dbbb for instance d409a4ad-aebe-4041-bbfc-6b76520d6d02 on hv-cinder-78626 Apr 14 16:22:32.270706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-6e9f88fd-558a-4430-8079-457cd92ac6fd req-54a0dbe4-f6c6-4a2a-ac62-725e7a32009c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039869 Apr 14 16:22:32.271397 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 627/1250] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:22:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:22:32.915007 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-bdc43b0d-ad39-41d8-a9d3-ffacb2e324e3 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:32.915951 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-bdc43b0d-ad39-41d8-a9d3-ffacb2e324e3 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:32.923386 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdc43b0d-ad39-41d8-a9d3-ffacb2e324e3 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:32.924084 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdc43b0d-ad39-41d8-a9d3-ffacb2e324e3 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:32.924846 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdc43b0d-ad39-41d8-a9d3-ffacb2e324e3 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:32.925371 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdc43b0d-ad39-41d8-a9d3-ffacb2e324e3 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:33.002452 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdc43b0d-ad39-41d8-a9d3-ffacb2e324e3 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:33.002750 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-bdc43b0d-ad39-41d8-a9d3-ffacb2e324e3 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:33.003261 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.objects.instance [None req-bdc43b0d-ad39-41d8-a9d3-ffacb2e324e3 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lazy-loading 'fault' on Instance uuid d409a4ad-aebe-4041-bbfc-6b76520d6d02 {{(pid=99334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 14 16:22:33.096602 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-bdc43b0d-ad39-41d8-a9d3-ffacb2e324e3 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:33.107714 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-bdc43b0d-ad39-41d8-a9d3-ffacb2e324e3 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 200 len: 1230 microversion: 2.1 time: 0.197071 Apr 14 16:22:33.108450 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 624/1251] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:32 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 1230 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:34.126909 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3c33f327-54ab-43a4-b9e0-07af15100710 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:34.127673 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-3c33f327-54ab-43a4-b9e0-07af15100710 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: d409a4ad-aebe-4041-bbfc-6b76520d6d02] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:34.136422 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c33f327-54ab-43a4-b9e0-07af15100710 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:34.136928 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c33f327-54ab-43a4-b9e0-07af15100710 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:34.137791 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c33f327-54ab-43a4-b9e0-07af15100710 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:34.138281 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-3c33f327-54ab-43a4-b9e0-07af15100710 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:34.191693 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-3c33f327-54ab-43a4-b9e0-07af15100710 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] HTTP exception thrown: Instance d409a4ad-aebe-4041-bbfc-6b76520d6d02 could not be found. Apr 14 16:22:34.192380 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-3c33f327-54ab-43a4-b9e0-07af15100710 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Returning 404 to user: Instance d409a4ad-aebe-4041-bbfc-6b76520d6d02 could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:22:34.193337 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-3c33f327-54ab-43a4-b9e0-07af15100710 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02" status: 404 len: 111 microversion: 2.1 time: 0.071047 Apr 14 16:22:34.193935 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 628/1252] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:34 2021] GET /compute/v2.1/servers/d409a4ad-aebe-4041-bbfc-6b76520d6d02 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:22:38.491277 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-a4798c1b-7bca-4749-889d-4e11aa1d65bd tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:38.491855 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a4798c1b-7bca-4749-889d-4e11aa1d65bd tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:38.493982 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-de1f5443-209a-434a-a037-d9e1ccd6008e req-29b4f98d-3821-49f8-9680-2c92224069df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e9d7202-fd85-4ea1-951b-77525e2984be", "tag": "e78fae0b-8829-413f-93d4-0aa5119937a2"}]} {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:22:38.495684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:22:38.495684 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:22:38.500111 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4798c1b-7bca-4749-889d-4e11aa1d65bd tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:38.500697 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4798c1b-7bca-4749-889d-4e11aa1d65bd tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:38.501659 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4798c1b-7bca-4749-889d-4e11aa1d65bd tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:38.502143 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-a4798c1b-7bca-4749-889d-4e11aa1d65bd tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:38.504582 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-de1f5443-209a-434a-a037-d9e1ccd6008e req-29b4f98d-3821-49f8-9680-2c92224069df service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:38.505179 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-de1f5443-209a-434a-a037-d9e1ccd6008e req-29b4f98d-3821-49f8-9680-2c92224069df service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:38.523426 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-de1f5443-209a-434a-a037-d9e1ccd6008e req-29b4f98d-3821-49f8-9680-2c92224069df service nova] Creating event network-changed:e78fae0b-8829-413f-93d4-0aa5119937a2 for instance 7e9d7202-fd85-4ea1-951b-77525e2984be on hv-cinder-78626 Apr 14 16:22:38.528916 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-de1f5443-209a-434a-a037-d9e1ccd6008e req-29b4f98d-3821-49f8-9680-2c92224069df service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039206 Apr 14 16:22:38.530191 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 629/1253] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:22:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:22:38.581519 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-a4798c1b-7bca-4749-889d-4e11aa1d65bd tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Going to try to terminate instance {{(pid=99334) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:22:38.707089 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-a4798c1b-7bca-4749-889d-4e11aa1d65bd tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 204 len: 0 microversion: 2.1 time: 0.219821 Apr 14 16:22:38.712374 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 625/1254] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:22:38 2021] DELETE /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:22:38.718681 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-250b38d0-b028-48bd-8510-4209f70e769e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:38.719443 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-250b38d0-b028-48bd-8510-4209f70e769e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:38.728270 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-250b38d0-b028-48bd-8510-4209f70e769e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:38.728776 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-250b38d0-b028-48bd-8510-4209f70e769e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:38.729651 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-250b38d0-b028-48bd-8510-4209f70e769e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:38.730144 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-250b38d0-b028-48bd-8510-4209f70e769e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:38.949281 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-250b38d0-b028-48bd-8510-4209f70e769e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:38.958825 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-250b38d0-b028-48bd-8510-4209f70e769e tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1578 microversion: 2.1 time: 0.244405 Apr 14 16:22:38.959465 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 630/1255] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:38 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1578 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:39.978123 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-782542f5-3aa6-49b4-93ae-7906f4dc9a62 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:39.978896 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-782542f5-3aa6-49b4-93ae-7906f4dc9a62 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:39.986858 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-782542f5-3aa6-49b4-93ae-7906f4dc9a62 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:39.987361 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-782542f5-3aa6-49b4-93ae-7906f4dc9a62 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:39.988196 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-782542f5-3aa6-49b4-93ae-7906f4dc9a62 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:39.988687 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-782542f5-3aa6-49b4-93ae-7906f4dc9a62 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:40.211413 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-782542f5-3aa6-49b4-93ae-7906f4dc9a62 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:40.220566 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-782542f5-3aa6-49b4-93ae-7906f4dc9a62 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1459 microversion: 2.1 time: 0.247478 Apr 14 16:22:40.221239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 626/1256] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:39 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1459 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:41.238958 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b2705fa6-5d15-4e77-9a33-2223ba49f7e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:41.240295 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b2705fa6-5d15-4e77-9a33-2223ba49f7e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:41.248236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b2705fa6-5d15-4e77-9a33-2223ba49f7e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:41.248744 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b2705fa6-5d15-4e77-9a33-2223ba49f7e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:41.249605 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b2705fa6-5d15-4e77-9a33-2223ba49f7e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:41.250100 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b2705fa6-5d15-4e77-9a33-2223ba49f7e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:41.496699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-847aa441-d5b5-4ddc-8a7d-061111e68641 req-15e31b4a-e6f7-453e-821e-7874f85a69d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9d7202-fd85-4ea1-951b-77525e2984be", "name": "network-vif-deleted", "tag": "e78fae0b-8829-413f-93d4-0aa5119937a2"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:22:41.499109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:22:41.499109 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:22:41.510518 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-847aa441-d5b5-4ddc-8a7d-061111e68641 req-15e31b4a-e6f7-453e-821e-7874f85a69d4 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:41.511040 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-847aa441-d5b5-4ddc-8a7d-061111e68641 req-15e31b4a-e6f7-453e-821e-7874f85a69d4 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:41.519217 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-b2705fa6-5d15-4e77-9a33-2223ba49f7e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9637a87d0cc41bb87b2437326c01992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9d2e253f144da0bf1bbc63b4657b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:41.530336 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b2705fa6-5d15-4e77-9a33-2223ba49f7e5 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 200 len: 1392 microversion: 2.1 time: 0.295401 Apr 14 16:22:41.531165 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 631/1257] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:41 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 1392 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:22:41.532151 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-847aa441-d5b5-4ddc-8a7d-061111e68641 req-15e31b4a-e6f7-453e-821e-7874f85a69d4 service nova] Creating event network-vif-deleted:e78fae0b-8829-413f-93d4-0aa5119937a2 for instance 7e9d7202-fd85-4ea1-951b-77525e2984be on hv-cinder-78626 Apr 14 16:22:41.543033 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-847aa441-d5b5-4ddc-8a7d-061111e68641 req-15e31b4a-e6f7-453e-821e-7874f85a69d4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050554 Apr 14 16:22:41.543693 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 627/1258] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:22:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:22:42.548087 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e904c6f6-9c18-4467-a251-cb9987f2d356 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:42.548758 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e904c6f6-9c18-4467-a251-cb9987f2d356 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: 7e9d7202-fd85-4ea1-951b-77525e2984be] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:42.556523 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e904c6f6-9c18-4467-a251-cb9987f2d356 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:42.557027 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e904c6f6-9c18-4467-a251-cb9987f2d356 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:42.557895 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e904c6f6-9c18-4467-a251-cb9987f2d356 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:42.558381 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e904c6f6-9c18-4467-a251-cb9987f2d356 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:42.611370 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-e904c6f6-9c18-4467-a251-cb9987f2d356 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] HTTP exception thrown: Instance 7e9d7202-fd85-4ea1-951b-77525e2984be could not be found. Apr 14 16:22:42.612022 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e904c6f6-9c18-4467-a251-cb9987f2d356 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Returning 404 to user: Instance 7e9d7202-fd85-4ea1-951b-77525e2984be could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:22:42.612911 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e904c6f6-9c18-4467-a251-cb9987f2d356 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be" status: 404 len: 111 microversion: 2.1 time: 0.068841 Apr 14 16:22:42.613560 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 632/1259] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:42 2021] GET /compute/v2.1/servers/7e9d7202-fd85-4ea1-951b-77525e2984be => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:22:43.570921 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2b7ce0d5-6ddc-4afa-98a3-e26148c08056 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:43.571540 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-2b7ce0d5-6ddc-4afa-98a3-e26148c08056 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:43.575191 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: ERROR oslo.messaging._drivers.impl_rabbit [-] [14bc9420-ead2-485c-ac78-3be3007a0eda] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 16:22:43.580863 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2b7ce0d5-6ddc-4afa-98a3-e26148c08056 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:43.581422 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2b7ce0d5-6ddc-4afa-98a3-e26148c08056 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:43.582263 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2b7ce0d5-6ddc-4afa-98a3-e26148c08056 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:43.582749 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-2b7ce0d5-6ddc-4afa-98a3-e26148c08056 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:43.638320 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-2b7ce0d5-6ddc-4afa-98a3-e26148c08056 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] HTTP exception thrown: Instance bca69cc6-ca35-4146-8a19-b3e35097b152 could not be found. Apr 14 16:22:43.638992 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-2b7ce0d5-6ddc-4afa-98a3-e26148c08056 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Returning 404 to user: Instance bca69cc6-ca35-4146-8a19-b3e35097b152 could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:22:43.639893 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-2b7ce0d5-6ddc-4afa-98a3-e26148c08056 tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 404 len: 111 microversion: 2.1 time: 0.074170 Apr 14 16:22:43.640507 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 628/1260] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:22:43 2021] DELETE /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:22:43.650057 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fa679dbc-ae49-43bc-a3b4-f42c6bae80ae tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:43.650778 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-fa679dbc-ae49-43bc-a3b4-f42c6bae80ae tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] [instance: bca69cc6-ca35-4146-8a19-b3e35097b152] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:43.665682 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fa679dbc-ae49-43bc-a3b4-f42c6bae80ae tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:43.666427 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fa679dbc-ae49-43bc-a3b4-f42c6bae80ae tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:43.667539 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fa679dbc-ae49-43bc-a3b4-f42c6bae80ae tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:43.668034 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-fa679dbc-ae49-43bc-a3b4-f42c6bae80ae tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:43.719998 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-fa679dbc-ae49-43bc-a3b4-f42c6bae80ae tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] HTTP exception thrown: Instance bca69cc6-ca35-4146-8a19-b3e35097b152 could not be found. Apr 14 16:22:43.720653 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-fa679dbc-ae49-43bc-a3b4-f42c6bae80ae tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Returning 404 to user: Instance bca69cc6-ca35-4146-8a19-b3e35097b152 could not be found. {{(pid=99335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:22:43.721584 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-fa679dbc-ae49-43bc-a3b4-f42c6bae80ae tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152" status: 404 len: 111 microversion: 2.1 time: 0.076430 Apr 14 16:22:43.722177 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 633/1261] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:43 2021] GET /compute/v2.1/servers/bca69cc6-ca35-4146-8a19-b3e35097b152 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:22:45.178158 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-48bd96fa-1bb7-44f0-8fc4-03f19a30900c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] Calling method '.version_select at 0x7ff58d304488>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:45.203219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO oslo.messaging._drivers.impl_rabbit [-] [14bc9420-ead2-485c-ac78-3be3007a0eda] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 57646. Apr 14 16:22:45.206696 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-48bd96fa-1bb7-44f0-8fc4-03f19a30900c tempest-TestVolumeBootPattern-35439365 tempest-TestVolumeBootPattern-35439365-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-643900673" status: 202 len: 0 microversion: 2.1 time: 0.032885 Apr 14 16:22:45.207318 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 629/1262] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Apr 14 16:22:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-643900673 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:22:58.607552 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-b63acd01-8608-4b50-810c-a08d2498eabe tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:58.608749 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b63acd01-8608-4b50-810c-a08d2498eabe tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:58.608871 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-25c1dcd0-e1d1-48c8-ad45-dec1bedf5566 req-b9a27bdc-d8e4-4ac5-a083-d73a710ce0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec37842c-337c-481a-b350-8055f911d09b", "tag": "eb2c22c1-6bf1-4f7d-b0f0-ca1c076c35be"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:22:58.610548 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:22:58.610548 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:22:58.620246 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-25c1dcd0-e1d1-48c8-ad45-dec1bedf5566 req-b9a27bdc-d8e4-4ac5-a083-d73a710ce0c0 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:58.620706 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b63acd01-8608-4b50-810c-a08d2498eabe tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:58.620826 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-25c1dcd0-e1d1-48c8-ad45-dec1bedf5566 req-b9a27bdc-d8e4-4ac5-a083-d73a710ce0c0 service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:58.621581 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b63acd01-8608-4b50-810c-a08d2498eabe tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:58.622659 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b63acd01-8608-4b50-810c-a08d2498eabe tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:58.623366 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-b63acd01-8608-4b50-810c-a08d2498eabe tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:58.639678 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-25c1dcd0-e1d1-48c8-ad45-dec1bedf5566 req-b9a27bdc-d8e4-4ac5-a083-d73a710ce0c0 service nova] Creating event network-changed:eb2c22c1-6bf1-4f7d-b0f0-ca1c076c35be for instance ec37842c-337c-481a-b350-8055f911d09b on hv-cinder-78626 Apr 14 16:22:58.646031 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-25c1dcd0-e1d1-48c8-ad45-dec1bedf5566 req-b9a27bdc-d8e4-4ac5-a083-d73a710ce0c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041069 Apr 14 16:22:58.647124 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 630/1263] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:22:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:22:58.708667 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-b63acd01-8608-4b50-810c-a08d2498eabe tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Going to try to terminate instance {{(pid=99335) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 14 16:22:58.829467 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-b63acd01-8608-4b50-810c-a08d2498eabe tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 204 len: 0 microversion: 2.1 time: 0.226162 Apr 14 16:22:58.830574 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 634/1264] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Apr 14 16:22:58 2021] DELETE /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:22:58.841317 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-e61a7bae-1a7c-46b5-9969-37d2c32a84ca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:22:58.842399 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-e61a7bae-1a7c-46b5-9969-37d2c32a84ca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:22:58.851409 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e61a7bae-1a7c-46b5-9969-37d2c32a84ca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:58.852160 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e61a7bae-1a7c-46b5-9969-37d2c32a84ca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:58.853286 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e61a7bae-1a7c-46b5-9969-37d2c32a84ca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:22:58.853998 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-e61a7bae-1a7c-46b5-9969-37d2c32a84ca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:22:59.808086 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-e61a7bae-1a7c-46b5-9969-37d2c32a84ca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99334) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:22:59.817156 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-e61a7bae-1a7c-46b5-9969-37d2c32a84ca tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1566 microversion: 2.1 time: 0.980442 Apr 14 16:22:59.817790 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 631/1265] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:22:58 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1566 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:23:00.840654 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-c4865a84-e2c7-4a9b-b724-43faf301ab80 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:23:00.841530 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-c4865a84-e2c7-4a9b-b724-43faf301ab80 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:23:00.850269 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4865a84-e2c7-4a9b-b724-43faf301ab80 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:23:00.851181 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4865a84-e2c7-4a9b-b724-43faf301ab80 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:23:00.852028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4865a84-e2c7-4a9b-b724-43faf301ab80 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:23:00.852518 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-c4865a84-e2c7-4a9b-b724-43faf301ab80 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:23:01.084780 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-c4865a84-e2c7-4a9b-b724-43faf301ab80 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:23:01.094858 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-c4865a84-e2c7-4a9b-b724-43faf301ab80 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1448 microversion: 2.1 time: 0.259557 Apr 14 16:23:01.096153 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 635/1266] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:23:00 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1448 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:23:01.643703 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [req-b56299a2-1c61-4318-a151-516045570722 req-ca4a594e-5e42-4288-8cd3-a97c97f6a26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec37842c-337c-481a-b350-8055f911d09b", "name": "network-vif-deleted", "tag": "eb2c22c1-6bf1-4f7d-b0f0-ca1c076c35be"}]} {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:23:01.646303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 16:23:01.646303 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: warnings.warn(msg) Apr 14 16:23:01.655537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-b56299a2-1c61-4318-a151-516045570722 req-ca4a594e-5e42-4288-8cd3-a97c97f6a26d service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:23:01.656028 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [req-b56299a2-1c61-4318-a151-516045570722 req-ca4a594e-5e42-4288-8cd3-a97c97f6a26d service nova] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:23:01.674442 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.compute.server_external_events [req-b56299a2-1c61-4318-a151-516045570722 req-ca4a594e-5e42-4288-8cd3-a97c97f6a26d service nova] Creating event network-vif-deleted:eb2c22c1-6bf1-4f7d-b0f0-ca1c076c35be for instance ec37842c-337c-481a-b350-8055f911d09b on hv-cinder-78626 Apr 14 16:23:01.679672 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [req-b56299a2-1c61-4318-a151-516045570722 req-ca4a594e-5e42-4288-8cd3-a97c97f6a26d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039940 Apr 14 16:23:01.680328 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 632/1267] 10.222.0.60 () {64 vars in 1308 bytes} [Wed Apr 14 16:23:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:23:02.114178 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-9c53b4b4-2e91-4538-b84a-28e22d63f5ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:23:02.115449 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-9c53b4b4-2e91-4538-b84a-28e22d63f5ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99335) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:23:02.123679 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c53b4b4-2e91-4538-b84a-28e22d63f5ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:23:02.124549 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c53b4b4-2e91-4538-b84a-28e22d63f5ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:23:02.125626 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c53b4b4-2e91-4538-b84a-28e22d63f5ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:23:02.126236 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-9c53b4b4-2e91-4538-b84a-28e22d63f5ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99335) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:23:02.259176 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.policy [None req-9c53b4b4-2e91-4538-b84a-28e22d63f5ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97db130f1f0412ab3a13ded5c7b7e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6afd00d65090450fa9559d0d5ef3a252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99335) authorize /opt/stack/nova/nova/policy.py:202}} Apr 14 16:23:02.268922 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-9c53b4b4-2e91-4538-b84a-28e22d63f5ee tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 200 len: 1219 microversion: 2.1 time: 0.158911 Apr 14 16:23:02.269639 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 636/1268] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:23:02 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:23:03.288800 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d01d21af-4db9-4fa8-a6cc-92c694c39fd1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '>' {{(pid=99334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:23:03.289593 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.compute.api [None req-d01d21af-4db9-4fa8-a6cc-92c694c39fd1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] [instance: ec37842c-337c-481a-b350-8055f911d09b] Fetching instance by UUID {{(pid=99334) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 14 16:23:03.297644 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d01d21af-4db9-4fa8-a6cc-92c694c39fd1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:23:03.298149 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d01d21af-4db9-4fa8-a6cc-92c694c39fd1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:23:03.298979 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d01d21af-4db9-4fa8-a6cc-92c694c39fd1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 14 16:23:03.299469 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG oslo_concurrency.lockutils [None req-d01d21af-4db9-4fa8-a6cc-92c694c39fd1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Lock "967aa7b0-fa4e-4888-a21e-20a4679b0859" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99334) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 14 16:23:03.352943 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.wsgi [None req-d01d21af-4db9-4fa8-a6cc-92c694c39fd1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] HTTP exception thrown: Instance ec37842c-337c-481a-b350-8055f911d09b could not be found. Apr 14 16:23:03.353639 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-d01d21af-4db9-4fa8-a6cc-92c694c39fd1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Returning 404 to user: Instance ec37842c-337c-481a-b350-8055f911d09b could not be found. {{(pid=99334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 14 16:23:03.354537 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-d01d21af-4db9-4fa8-a6cc-92c694c39fd1 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b" status: 404 len: 111 microversion: 2.1 time: 0.070890 Apr 14 16:23:03.355142 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99334|app: 0|req: 633/1269] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Apr 14 16:23:03 2021] GET /compute/v2.1/servers/ec37842c-337c-481a-b350-8055f911d09b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:23:03.562699 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: DEBUG nova.api.openstack.wsgi [None req-f474772e-07a4-4e8a-bfda-b521c3fc4ca0 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] Calling method '.version_select at 0x7ff58ca32d90>' {{(pid=99335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 14 16:23:03.584573 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO nova.api.openstack.requestlog [None req-f474772e-07a4-4e8a-bfda-b521c3fc4ca0 tempest-TestShelveInstance-1091889729 tempest-TestShelveInstance-1091889729-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-938127160" status: 202 len: 0 microversion: 2.1 time: 0.025855 Apr 14 16:23:03.585278 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: [pid: 99335|app: 0|req: 637/1270] 10.222.0.60 () {58 vars in 1241 bytes} [Wed Apr 14 16:23:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-938127160 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:24:01.590669 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:24:01.591225 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: Wed Apr 14 16:24:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 14 16:24:45.371502 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:24:45.372030 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: Wed Apr 14 16:24:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 14 16:25:50.375613 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:25:50.376150 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: Wed Apr 14 16:25:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 14 16:26:07.117597 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:26:07.118239 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: Wed Apr 14 16:26:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 14 16:27:19.827603 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:27:19.828177 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: Wed Apr 14 16:27:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 14 16:27:21.607224 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:27:21.607712 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: Wed Apr 14 16:27:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 14 16:28:03.923046 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:28:03.923670 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: Wed Apr 14 16:28:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 14 16:28:05.388219 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:28:05.388752 dv-cinder-786266-1-iscsi devstack@n-api.service[99333]: Wed Apr 14 16:28:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!